Post

In my quest to understand the true nature of an Agent I have been thinking a lot about the loop and the actions and the environment. And I think i see where we're headed next. Agents are not going to be like chatbots. They are going to be like programming languages come alive.

Right now most people's working definition of an agent is "a language model in a loop with some tools", right? This is the ReAct paradigm. The models are trained around it, from data formatting to inference stack. Tool calling, function calling, MCPs all rely on this turn-by-turn structure.

But context is still the bottleneck, and all the tool call inputs and outputs still have to go through the input. In the meantime we had things like CodeAct, and Code Mode, and Claude Code, that give the model access to some kind of REPL

(Read Eval Print Loop, an interactive computational environment, like a terminal or a programming language notebook). And we’ve seen models simulate computer environments as well, like in worldsim and Infinite Backrooms.

People realized the model didn't have to simulate just a chatbot. It could simulate a computer. Or a computer user. Once you get RL with verifiable rewards, computer environments suddenly became the thing for models to learn. You can tell whether your model did it right by how well the code runs!

The user is still in a privileged position. The outer conversation loop with the model is still "the main world". But it can do stuff in its computational environment and that stuff persists.

The squishy human is no longer the whole environment. There is an ontologically hard reality and it's the computer world, the files and folders and programs within.

The Recursive Language Model (RLM) pushes this a step further: What if we don't have a "chat" at all? What if we make the user just a function inside the computer? In fact, what if we put the agent inside the computer too?