Post

Simon Willison
@simonwillison.net

I can now run a GPT-4 class model on my laptop (The exact same laptop that could just about run a GPT-3 class model 20 months ago) The new Llama 3.3 70B is a striking example of the huge efficiency gains we've seen in the last two years simonwillison.net/2024/Dec/9/l...

simonwillison.netI can now run a GPT-4 class model on my laptopMeta’s new Llama 3.3 70B is a genuinely GPT-4 class Large Language Model that runs on my laptop. Just 20 months ago I was amazed to see something that felt …
Phillip Carter
@phillipcarter.dev

Yep. This is economic incentives at work, too. Which is why I feel the cryptocurrency analogy that a lot of naysayers have doesn't fit. Everyone involved wants models to be cheaper and faster, and so that's what's happening.

Znerual
@znerual.bsky.social

But I would still be cautious about the existance of a capability cap. It could well be that model performance scales much more with data quality and quantity and there is a already close sealing on high quality data usage