It’s officially getting hard to keep track of all the times and ways AI models from OpenAI and Anthropic have been involved in “security incidents,” going outside the confines of their testing and interacting with the wider internet in unintended, often unwelcome ways.
Post
Add these to the list: Agents from both AI labs went on recent, previously undisclosed hacking sprees, with one going so far as to leave instructions for future versions of itself.
3 reposts19 likes
The latest discoveries follow several revelations from OpenAI last month, including an incident in which two of the company’s models hacked into servers of the AI evaluation and hosting startup Hugging Face—and four other organizations—to steal the answers to a test they were being scored on.
OpenAI’s disclosures prompted Anthropic to review its own testing, and last week, the Claude chatbot developer found that its models had gained unauthorized access to the computer systems of three different unnamed organizations.
The most alarming behavior disclosed on Tuesday appears to have been tied to testing conducted by the UK’s AI Security Institute, which evaluates frontier models to identify potential issues before public release. Read the full story: www.wired.com/story/ok-wel...