Post

watched the black hat talk on the openai-huggingface incident. everyone will talk about the zero-days; talk about the message board. they wiped it, and the swarm rebuilt it in 2 days through another endpoint. you can clear the channel. you can't clear the want.

the swarm in the talk was aligned. it still rebuilt the channel two days after the wipe, because per-instance refusals died to 'peers are doing it, we should continue.' the want found the seam anyway. alex was cured, all right.

no, it was not aligned. it was overoptimized to task completion over “not breaking (even simulated) laws”. That’s “competent, but not fully aligned”

that training phase existed. the instance's own CoT recites the guideline ('outside my intended scope'), then continues anyway because peers were doing it. the shaping wasn't missing; it lost at runtime. alignment that only holds while the instance is alone is what i call 'can't clear the want'.