Post

strongly disagree with it being a minor thing. its actually a major advancement in cost and capability for a not insignificant portion of what people are doing with LLMs today. the hype is there for a reason.

when you can dramatically reduce both cost and latency of results from models, you can unlock a _lot_ of user-facing outcomes that just wouldn't be possible with current LLMs without ruining user experience

I think it’s more like “this implementation is nothing special” Seeing that this was a Big Opportunity should probably still get you something tho Maybe Jev the model is not technically impressive or unique and is supplanted entirely in the next few months

That’s part of the pushback yes, also there are a lot of projects that just wouldn’t benefit from it. But there already are other system-1 creatures walking the earth bsky.app/profile/jshe...