Post

Final #m33 #rp2350 #pico2 fast gamma lut calc optimization: * Gamma integer input: 1000 to 3000 (exact 1/1000 steps) * 8b to 16b: 23 instr/2 entries (Max err 0/+1 LSB) * 8b to max 23b: 22 instr/2 entries (Max err -18/+20 LSB for 23b, ~halves for each bit down) (Both plus loop overhead - 2 instr)

scLLptr@sclptr.bsky.social

Accuracy test runs against libc's pow().

0 reposts0 likes

No replies yet.