Post
Something like this is now possible thanks to smaller LLMs and wider support for structured output. And, of course, all the work by @tjmiller.bsky.social and the community on Prism!
On my M3 Pro MacBook, I'm getting fairly fast, and very consistent structured output with Ollama and the Llama 3.2 model
0 reposts0 likes
No replies yet.