Rob Bensinger

Rob Bensinger

@robbensinger.bsky.social

627 followers28 following99 posts

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

Frontier AI training currently requires city-sized data centers and specialized hardware built in a single brittle supply chain running through multiple allied nations; this is not a hard technology to hit the pause button on, if we get ahead of it and act...

... before we RSI and proliferate our way to significantly more powerful and easily-trained systems. We’ve faced harder problems before, and won. My only fear is that we may be too slow, too late, when everything and the world needs us to be fast.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

I keep thinking about a thing David Krueger (previously at UK AISI) said: “My dream is that in 10 years people will look back and say: ‘Remember when there were all these people building AI that could’ve killed everybody? That was CRAZY! What were we thinking!?’”

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

The Pope is warning about “whether it will be possible to control these machines in the future, and whether humankind runs the risk of becoming a victim of its own inventions.” Hell, Jensen Huang sounds like he’s starting to come around.

If Trump and Xi get a briefing tomorrow that convinces them to act on this, we could be on a fast track within the week to solving this problem. For the first time, I’m starting to let myself imagine a very near future where this is a problem we’ve already solved.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

In the last month, I’ve seen a completely insane sea change in how seriously people are taking this. Per Politico’s September polling, even a majority of Trump voters with a view now favor an immediate halt to AI development.

And 68% think there’s a “moderate,” “significant,” or “almost certain” chance of AI destroying humanity, versus 32% who think there’s a “very small risk” or “no risk.”

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

But if everyone systematically does this, then the world ends up with a skewed picture of the actual threat. Even more so once we start copying each other’s claims and form a reassuringly moderate-sounding echo chamber.

If we never allow ourselves to acknowledge the worlds where we’re running out of time, then the policy community will always be reacting to a false model that’s months or years out of date. I don’t think it’s too late. I genuinely think this is a solvable problem.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

And meanwhile, we’re stuck in the world where every other problem under the sun has been sensationalized and overstated for decades. How do we talk about this seriously? How do we convey that this is actually happening?

- In many of the worlds where we survive, we have more than just a few months left. It’s tempting to write off those worlds as hopeless, and skew everything we say to emphasize the longer-term scenarios and downplay the shorter-term ones.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

Is a 10% chance of us all dying in the next 18 months a “low” probability, because it’s under 50%? Is it a “high” probability, because a 10% chance of death in literally any other context would sound insanely high? Even “high probability” doesn’t communicate the situation with any clarity.

In drug safety or airplane safety, a 1 in 10,000 risk of death would be considered “high”. No engineering field in human history has ever been in a situation like this. No invention in history, nuclear weapons included, has ever caused a reaction like this in its inventors.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

Grace et al. (2026) found that a majority of established AI researchers think there’s a double-digit chance of an extinction-level outcome from continued R&D. Are these the kinds of things you see 4 years before the window closes for USG to act, or 4 months?

I don’t think it’s especially reasonable to be shocked by either timeline at this point. - Since we don’t have a way to robustly measure or bound the risk, the temptation is to avoid giving probabilities. But then everything you say is fractally misunderstandable.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

Paul Christiano, the inventor of RLHF and the research community’s most prominent proponent of “AI may take off slowly” a few years ago, now thinks that 50-75% of humanity’s all-time AI loss-of-control risk is concentrated in the next three years (!!!).

Frontier employees are signing 1000+ person petitions begging the government to intervene immediately. Employees are quitting their jobs and giving up millions of dollars of equity to try to warn policymakers and journalists.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

... in front of them, and rapidly updating in real time to “this looks unbelievably bad”. How do you put a year on that? The future is hard to predict, and nobody actually knows that we’re going to hit existentially dangerous AI this year, or even in the next four years.

But the warning signs are pretty batshit at this point. A single AI, with a single user prompt, just solved hundreds of important long-established open problems in mathematics, problems mathematicians had spent their entirely lives working on, in a matter of ~3 hours per problem.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

This is not the kind of problem you can solve at the last minute. As with many exponentials, the likeliest outcome is that you’re either embarrassingly early, or you’re too late.

- How do you communicate “we don’t have a robust way to predict timelines, but everyone in the field is freaking out and a lot of us genuinely think we’re about to die?” Where’s the proof? There isn’t any proof: it’s an entire field of engineers who are eyeballing what they’re seeing...

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

Which is different from “when will the tech have advanced and proliferated to the point that any regulatory options that still have a chance of working would be way more extreme and unpopular than just some international restrictions on data center usage?”

Extinction is the emotionally salient, easy-to-understand threshold -- Jacob Coxon demonstrated that it helps to be honest about this. But the other thresholds could legitimately come years earlier, in which case focusing on extinction is ironically misleadingly reassuring.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

View full thread

Do the things that could actually work, like broad political coalition-building, not doomer LARPing as a form of self-expression. I think part of why people aren’t being clear about this is that it’s actually a tricky communication problem:

- Predicting “if frontier R&D continues at its current pace, when are we likely to die?” may give a different answer than predicting when permanent loss of control is likely, which is different from “realistically, when is it too late for governments to stop this”.

It seems to me that we’re at “it’s time to panic about AI”. I gather that a lot of researchers are worried that we may be about to die, on a timescale of months, but this still isn’t quite in the Overton window so we’re still soft-pedaling.

Where “panic”, of course, means “quickly and soberly initiate talks with the CCP to achieve a moratorium on large training runs, backed by a deterrence regime, compute and supply chain monitoring, and site inspections”. Pray that a deal can be reached, and pray that there’s still time.

I showed the original tweet to my partner, Dominiq. In under five seconds, they said: "This is a clip from a real Monet painting, I'm pretty sure." And: "I'm pretty sure I know which painting that is." 1/

View full thread

I showed the original tweet to my partner, Dominiq. In under five seconds, they said: "This is a clip from a real Monet painting, I'm pretty sure." And: "I'm pretty sure I know which painting that is." 1/

View full thread

"I think part of the reason why I've stared at so much Monet is because my grandmother was also a gardener, who loved her garden. Who lost her eyesight to diabetes, and who I knew only ever in my life as blind, and obsessing about her garden out the window which she could barely see...

I showed the original tweet to my partner, Dominiq. In under five seconds, they said: "This is a clip from a real Monet painting, I'm pretty sure." And: "I'm pretty sure I know which painting that is." 1/

View full thread

"And so a lot of the style that people associate with Monet was what he actually saw as his eyesight reduced down -- to light, color, and shadow. When you look at Monet, you are seeing through Monet's failing eyes. And as you look at his later work, you can see as his eyesight grew worse and worse.

"Which, I suppose, looks more and more 'impressionist.' "I've spent a long time staring at Monet's pictures. Trying to decide what was an artistic choice, to represent something, and what was him trying to express what he actually saw.

I showed the original tweet to my partner, Dominiq. In under five seconds, they said: "This is a clip from a real Monet painting, I'm pretty sure." And: "I'm pretty sure I know which painting that is." 1/

They said: "Impressionism was partially fueled by paint becoming available in tubes that you could carry out with you into the field. The idea of capturing the light as it stood, in that moment. "Please think of Degas and his ballerina dancers. People at luncheons in the sunshine. People dancing.

"A lot of my favorite impressionist pictures are people dancing. Trying to capture the light on their clothes, as they moved. "The special thing about Monet, which makes him stand out to me, is that he was losing his eyesight. And was deeply in love with his garden.

Rob Bensinger reposted

Introducing AI StopWatch. It’s easier to speak up when you know what’s going on. It’s easier to see what’s coming when you know what’s already here. (1/9)

Who should I add to this? Also, did I get anyone's view wrong? What's your own view about AI companies' attempts to build ever-larger data centers in the race to build superhuman AI?

Note that people's placements are very approximate, and reliant on some amount of guesswork. Also, there are huge selection effects: most people haven't publicly weighed in on this topic! Treat this image more like a vague review of public statements, and less like a representative survey.

Rob Bensinger reposted

Replying to @stuntbirdarmy.bsky.social

Good thing it's only killing them off figuratively... for now. bsky.app/profile/robb...

Rob Bensinger@robbensinger.bsky.social

Senior White House officials, a retired three-star general, a Nobel laureate, and others come out to say that you should probably read Eliezer Yudkowsky and Nate Soares' "If Anyone Builds It, Everyone Dies".

Rob Bensinger reposted

A tale of two warning shots, #1: COVID happened. Scientists are divided on whether it was a lab leak. The world did not rally against dangerous viral research in labs. The warning shot was squandered.