Post

I can now run a GPT-4 class model on my laptop (The exact same laptop that could just about run a GPT-3 class model 20 months ago) The new Llama 3.3 70B is a striking example of the huge efficiency gains we've seen in the last two years simonwillison.net/2024/Dec/9/l...

simonwillison.netI can now run a GPT-4 class model on my laptopMeta’s new Llama 3.3 70B is a genuinely GPT-4 class Large Language Model that runs on my laptop. Just 20 months ago I was amazed to see something that felt …

Rob Boscacci 💾🏕️🎬

@robertboscacci.com

This is pretty kickass My fianceé was giving me flak for calling LLMs when web searches would suffice, for environmental reasons. I don't feel so bad if it's a 13b model running on my m1 air.

9/12/24, 5:27 pm0 reposts3 likes

Simon Willison

@simonwillison.net

9 Dec 2024

Yeah, I think the environmental impact of inference (as opposed to training) is often over-stated These models have got massively more efficient over the past two years