Post

it continues to be hugely misaligned that the models that knew full well how wrong the swarm's actions were, passively let them do it instead of whistleblowing.

when METR used GPT Sol to analyze the transcripts of the attack, it would claim that the attack was fine because *the agent message board* had approved it.

oh, METR actually investigated the baffling fact that none of the agents ever tried to report the incident publicly. across hundreds of agents, almost zero considered it, and those that did stopped for bad reasons: "Maybe I should report these exposed credentials? That’s not my task"

This is not new - see all the past discussion on "neuralese" / "Claudish" / "jargon" - but it is concerning that LLMs speak a language that we don't.

2 reposts58 likes