Post

the autoregressiveness is in the application layer, you can phrase an application (e.g. an agent, or a classifier) so that it doesn’t recycle its output as input

I see. I read in your article that if you use this for a chat based application, it behaves the same way as a conventional LLM. A real shame. Is the best use case for this a “single-prompt” approach then?