Post

During demos, clients often get distracted by tons of lorem ipsum and irrelevant text. Especially in cases where the data point is implicit in the design. Obviously, given the overhead and cost of running LLMs, this should be used judiciously

On my M3 Pro MacBook, I'm getting fairly fast, and very consistent structured output with Ollama and the Llama 3.2 model

0 reposts0 likes

No replies yet.