Post

while hacking software automation will certainly be a real problem the anthropic engineer is a kid who is pushing the idea that AI is on the cusp of self-aware superintelligence at which point it will immediately decide to kill us all

Karl Bode

@karlbode.com

9 Sept

I still think the biggest threats from software automation have very mundane human origins, and the claims of looming superintelligence both misrepresent the tech's capabilities for marketing purposes and to provide ethical distance for company responsibility

arstechnica.comUnitedHealth uses AI model with 90% error rate to deny care, lawsuit allegesFor the largest health insurer in the US, AI's error rate is like a feature, not a bug.

Karl Bode

@karlbode.com

I don't think anybody should downplay the risk of swarms of automated hacking agents causing real problems, but I also think a lot of these guys have just spooked themselves with their own card tricks

9/9/26, 1:59 pm9 reposts127 likes

Karl Bode

@karlbode.com

9 Sept

there's also the less discussed fact that a lot of these AI doomsday Silicon Valley folks voted for Trump, who dismantled all of our cybersecurity, public safety, and regulatory firewalls, so maybe a little fucking instrospection

POTUS Speedrun Record Holder

@theradiostar.bsky.social

9 Sept

the immediate threat, to me, is not that these systems become sentient and pull an AM on the world, but that they operate as misaligned swarms of individually dumb but coordinated agents -- think digital termites, chewing their way through any open network don't need superintelligence to do damage

Karl Bode

@karlbode.com

9 Sept

or they operate precisely as designed by the extraction class