Post

A fortnight of headlines about AI killing us all, and the thing actually coming at us is getting little attention as a result. It's not the models getting smarter, it's that we're wiring them up to everything, and nobody has worked out how to do that safely yet. blog.robbowley.net/2026/09/18/t...

At least it's out of my head now, but I'm genuinely worried, particularly for the tsunami of cyber attacks I see coming

Also orgs are getting fast and loose wiring agents into their systems as fast as they can, chasing promised productivity, building on something we don’t know how to contain, and shipping it to everyone while we work it out.

>... nobody has worked out how to do that safely yet. Mostly because it is physically impossible to do so. Essay in the Communications of the ACM spelled out why, years ago. Basically comes down to the hazards of mixing command and control in the same channel. Oops. cacm.acm.org/opinion/llms...

I am less worried about the cyber attacks from Ai agents and more about the cyber attacks against Ai agents. The first would be an attacker using a model to carry out attacks. LLMs often make this annoyingly hard, they refuse too much. To jailbreak them you need trained criminals which are rare.