This has been a delight to see come together. The joint keanu_woah.gif moments Annie and I have had learning about this space have been awesome. You’re gonna love it!
Compression and LLMs are trying to solve the exact same problem: predicting what comes next. @anniesexton.com's interactive essay walks us through the basics of compression to reveal its surprising overlap with every language model you've ever used.