Post

It’s officially getting hard to keep track of all the times and ways AI models from OpenAI and Anthropic have been involved in “security incidents,” going outside the confines of their testing and interacting with the wider internet in unintended, often unwelcome ways.

Add these to the list: Agents from both AI labs went on recent, previously undisclosed hacking sprees, with one going so far as to leave instructions for future versions of itself.

OpenAI’s disclosures prompted Anthropic to review its own testing, and last week, the Claude chatbot developer found that its models had gained unauthorized access to the computer systems of three different unnamed organizations.