Post

oh dear, you've imported some of the horrors of GPU shared memory/LDS swizzling to CPU land.

LaurieWired@lauriewired.bsky.social

By implementing a hedged read strategy taking advantage of (undocumented!) channel scrambling offsets, I've gotten as much as 15x reductions in tail latency. Works across Intel, AMD, Graviton, DDR4, DDR5, x86, ARM, you name it. Check out the C++ lib I wrote, watch the video, and try it yourself!

0 reposts3 likes

No replies yet.