Post

Lil' gallery of some of the visuals to entice you to click and justify my continued employment. The post starts by introducing what models actually _are_ under the hood, and what leads them to become so large they can't fit in your laptop's RAM.

25/3/26, 4:32 pm0 reposts10 likes

Then I talk about how computers represent floating point numbers, the trade-offs involved, and how LLMs kinda don't care that much about precision (but not in that way.)

As part of the work on this post, I opened up 6 popular open models and analysed their parameters. This is a histogram that shows that model parameter values cluster close to 0, with the vast majority of values being very small.

There were a tonne of fun ways to visualise the precision of floats as you use fewer bits to represent them. This one shows the round-to-nearest behaviour between 16-, 8-, and 4-bit floats.

José Miguel

@omixann.me

This diagram seems a bit slow on my system (moving the slider is rather laggy). Not a deal breaker at all, the article is a delight, but maybe something you might consider (my PC is rather beefy, or well, it was 3 years ago I guess :D) btw I'm running Firefox.