Post

So that’s new lol. I’ve been playing with the Gemma 3 models in a pure CPU env to identify lower operating thresholds and it’s been great…the 1B model is under a gig I think and performs really great.

No idea, I don't know why more model providers don't take that on themselves, it's pretty risky leaving it to the community as a bad quantization could give your model an undeserved bad reputation

We tried it in the past but developers like lmstudio prefer doing this themselves so giving them a better starting point seemed to work better

Imagine if we got this 20 years ago, something able to understand and write language, that fits on less than half a CD, but requires monstrous amounts of computation. It would be like alien technology, practically beyond our comprehension.