Post

I’ve put a ton of tokens through Jev now, and...I have thoughts. 1. The big labs lost the script TypeSafe’s intro video says, “We’re building prod, not God” — and can I just say? Hell yeah.

@typesafeai built something for engineers like me, so I can build products for people like your mom (she says hi btw). They’re not trying to create “Machines of Loving Grace”; they’re trying to build things that let OTHER HUMAN BEINGS create new types of products.

The proof is in the pudding. When ChatGPT shipped, we were all blown away by…ChatGPT. When Jev shipped, we were all blown away by what everyone was making with it.

I cannot tell you how refreshing this is. It takes a sincere form of humility to believe that you, the creator of a technology, will not be the best at deploying the technology into the marketplace.

The big labs, especially Anthropic, have proven not to have this humility…and now everyone hates AI. Thanks, Dario. I guess what I’m saying is: Diogo for president.

2. Ultra-smart classifiers were genuinely a missing primitive. I don’t know how this got missed. Diogo calls it “machine-native intelligence,” and that’s really what it is.

I cannot tell you how much bending and twisting I've had to do with LLMs to get them to act like a classifier when they just weren’t. I’m absolutely shocked this is the first time this “type” of model has come to market.

These models will unlock AI utility for entire industries: robotics, trucking, aviation, meteorology, finance, defense, retail…even your smart coffee mug is going to use this.

3. It’s still too expensive Jev is really, really cheap compared to LLMs. But you don’t use it like an LLM. In my full self-driving example, or any robotics example, you’ll be making decisions several times per second continuously. The #1 value proposition of a model like this is speed and cost.

To be clear, at current pricing, the model will still be successful and well integrated. It will be able to replace a number of tasks that were already being performed (poorly) by LLMs. However, to unlock industrial-scale demand (Jevons paradox), I believe it needs to be roughly 10x cheaper.

The good news is Diogo said on a recent AMA that they have substantial margin at their current pricing and have already considered dropping the cost further. I hope it's a lot further.

4. Latency is a real limiter I really hope TypeSafe AI works with an edge network provider to improve the co-location of models and reduce network latency. Ultimately, these models really need to run on-device.

I would even be willing to pay some kind of recurring license fee to have a great closed model running on my own hardware, just so I can reduce the TTD (Time To Decision) as much as possible. Imagine running a model like this at 60 Hz, or even 120 Hz.