Post

New chapter for Agentic Engineering Patterns: I tried to distill key details of how coding agents work under the hood that are most useful to understand in order to use them effectively simonwillison.net/guides/agent...

Regarding reasoning, how exactly does that process work? Is it that the model is generating text which it then analyzes with existing context before generating more text?

It's more that it talks through the problem in advance - here's an example from a small (weak) model running on my laptop thinking about how to draw a pelican gist.github.com/simonw/cd417...

To generate the self-check portion of the response below though it has to have the context of what it has already generated so far though right? So it has to be looking back at generated info as it's going and producing new text (I think). Mostly just trying to understand the underlying mechanism