Post

I spent 2 months learning about quantization and am extremely proud of the post I've written about it. I think these are some of the nicest visuals I've ever made, and I love how this compression technique invented in 1898 is being used on the bleeding edge in 2026. ngrok.com/blog/quantiz...

ngrok.comQuantization from the ground up | ngrok blogA complete guide to what quantization is, how it works, and how it's used to compress large language models

seed paste soy goblin

@phasebinary.bsky.social

26 Mar

This is a fantastic approach! But I was really surprised to learn the quantizations are just linear. Do any of the following perform better? - linear in the middle with bookends for outliers - Gaussian-like - "control points" fit to a curve between them

Sam Rose

@samwho.dev

There are non-linear ones! Google’s TurboQuant for example is based off of a Lloyd-Max quantizer, which adapts the bucket sizes to the data it’s fitting. I kept it simple for the post, partly to make it accessible and partly to make it not too long. The method I cover is used in GGUF and MLX.

26/3/26, 7:06 am0 reposts2 likes

No replies yet.