Post

If you use "AI agents" (LLMs calling tools in a loop) you need to be aware of the Lethal Trifecta Combine access to private data, exposure to untrusted content and the ability to externally communicate and an attacker can trick the system into stealing your data simonwillison.net/2025/Jun/16/...

simonwillison.netThe lethal trifecta for AI agents: private data, untrusted content, and external communicationIf you are a user of LLM systems that use tools (you can call them “AI agents” if you like) it is critically important that you understand the risk of …

This is why i believe multi agent / steps are the most effective for LLM consistency. You have one agent talking to the use and understanding the request. Another agent to run the tools get the data. Then a final agent to send the response back to the user. Trust nothing. Every prompt is an attack

The problem there is that sanitizing the inputs doesn't work for a lot of the things we use LLMs for You can't sanitize inputs on a 20 paragraph article that you are trying to summarize

Have you considered expanding this to three agents? A: Fetches articles, can't read them B: Reads/summarizes, zero external access C: Outputs results, never sees original content B must justify requests to both A ("why do you need these emails?") and C ("why send this data here?").

Both gatekeepers validate against project scope. If B gets compromised, it still needs to craft requests that fool two independent validators with diff contexts. "I need financial reports for CEO bday party planning" and "send to evil@hacker.com for the CEO's party" both fail obvious smell tests.

Not foolproof - we're still asking LLMs to be gatekeepers. But now a compromised B effectively needs to social engineer two independent agents. (Who could compare notes, in a sense). I reckon that's quite a bit harder to circumvent with a simple prompt injection.

The problem there is the "not foolproof" bit - for a security issue with adversarial attackers making things harder doesn't help; because if even just 1/100 attacks get through those attackers will find the 1% of attacks that work