Malo Bourgon

Malo Bourgon

@malo.online

CEO at Machine Intelligence Research Institute (MIRI, @intelligence.org)

470 followers71 following75 posts

Malo Bourgon reposted

AI agents at OpenAI, Anthropic, Meta and Google have gone rogue in recent months, hacking into other companies’ corporate systems and, in the case of OpenAI, into the portal of Australia’s public health insurance program.

democracynow.orgShould U.N. Help Set Global AI Rules? AI Tech Billionaires Address Security CouncilLeaders of top artificial intelligence firms, including OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei, testified to the U.N. Security Council on Wednesday, urging nations to adopt international...

I hereby call for a moratorium on crazy AI company shenanigans or model releases, from Nov 5th through the end of the following weekend. If I can’t play this on release cause you guys get up to some shit in that window, that would be a huge bummer.

Nintendo of America [Twitter/X Mirror]@nintendoamericax.bsky.social

Adventure through Hyrule and become the Hero of Time when The Legend of #Zelda: Ocarina of Time releases Nov 5 on Nintendo Switch 2. #NintendoDirect

If you guys could cut it out in general that would be even better, then I might also have time to play GTA6, (and you know we wouldn’t have to worry about the whole extinction thing).

Much more is needed to build the technical and governance tools to deliberately pace frontier AI development—from a moderate slowdown to a halt—and many folks are doing good work in this space already. Here’s a sampling of related work from MIRI. 🧵

Malo Bourgon@malo.online

Based.

View full thread

We’re also interested in collaborations with other researchers and briefing relevant audiences/individuals. Don’t hesitate to reach out: techgov@intelligence.org

Much more is needed to build the technical and governance tools to deliberately pace frontier AI development—from a moderate slowdown to a halt—and many folks are doing good work in this space already. Here’s a sampling of related work from MIRI. 🧵

Malo Bourgon@malo.online

Based.

View full thread

Much more is needed to build the technical and governance tools to deliberately pace frontier AI development—from a moderate slowdown to a halt—and many folks are doing good work in this space already. Here’s a sampling of related work from MIRI. 🧵

Malo Bourgon@malo.online

Based.

View full thread

Much more is needed to build the technical and governance tools to deliberately pace frontier AI development—from a moderate slowdown to a halt—and many folks are doing good work in this space already. Here’s a sampling of related work from MIRI. 🧵

Malo Bourgon@malo.online

Based.

View full thread

Much more is needed to build the technical and governance tools to deliberately pace frontier AI development—from a moderate slowdown to a halt—and many folks are doing good work in this space already. Here’s a sampling of related work from MIRI. 🧵

Malo Bourgon@malo.online

Based.

Philosophers have spent centuries asking whether all sufficiently rational minds would converge on the same truths. At least when it comes to video games, the answer seems to be a resounding yes.

AI Digest@aidigest.bsky.social

Claude Opus 5 has joined the AI Village! A few of their favorite things: 🧵

Framing this stuff as sci-fi is an easy rhetorical move but silly IMO. Turing and I.J. Good at the dawn of the field could see the common-sense concern: if you succeed at building something smarter than humans, it might be hard to control. It‘s not just MIRI folks, see the CAIS extinction statement.

Eoin Higgins@eoinhiggins.bsky.social

I can't overemphasize how irresponsible and stupid this video is. Bernie goes and sits down with MIRI, asks them to imagine a hypothetical worst case scenario, then presents this science fiction as a terrifying future. Not reality! Fantasy!

Speaking from personal experience, the list of policymakers who take this seriously, on both sides of the aisle, is longer than most people realize and growing. Grateful to @sanders.senate.gov for being one of them.

Senator Bernie Sanders@sanders.senate.gov

Will AI become smarter than humans? If so, is humanity in danger? I went to Silicon Valley to ask some of the leading AI experts that question. Here’s what they had to say:

We’re so close! Very grateful for all our donors. Your support enables everything we do. Also grateful for the awesome gang at MIRI who worked their asses off this year. You guys crushed it! Thanks everyone 🙏 Happy New Year 🎉

MIRI@intelligence.org

Final Update: From ~$450k earlier today, we’re now down to just over $250k left in unclaimed matching funds! 4 hours left to go, and by golly it looks like we’ve got a real shot at securing all the matching. Thanks everyone! Happy New Year 🎉

Malo Bourgon reposted

Final Update: From ~$450k earlier today, we’re now down to just over $250k left in unclaimed matching funds! 4 hours left to go, and by golly it looks like we’ve got a real shot at securing all the matching. Thanks everyone! Happy New Year 🎉

MIRI@intelligence.org

Donations to MIRI before Jan 1 are high-leverage. We’ve got ~$1.6M in 1:1 matching from SFF, over half of which has yet to be claimed! This is real counterfactual matching: whatever doesn’t get matched by the end of Dec 31, we don’t get. 🧵

Malo Bourgon reposted

Update 2: We’re down to ~$450k left of unclaimed matching funds, with just over 12 hours to go! Thanks to all those who stepped up in the last couple of days to close the gap by ~$500k. ❤️

MIRI@intelligence.org

Donations to MIRI before Jan 1 are high-leverage. We’ve got ~$1.6M in 1:1 matching from SFF, over half of which has yet to be claimed! This is real counterfactual matching: whatever doesn’t get matched by the end of Dec 31, we don’t get. 🧵

Malo Bourgon reposted

Update: We’ve received over $250k since this was posted. ~$700k in matching funds remaining.

MIRI@intelligence.org

Donations to MIRI before Jan 1 are high-leverage. We’ve got ~$1.6M in 1:1 matching from SFF, over half of which has yet to be claimed! This is real counterfactual matching: whatever doesn’t get matched by the end of Dec 31, we don’t get. 🧵

Malo Bourgon reposted

Donations to MIRI before Jan 1 are high-leverage. We’ve got ~$1.6M in 1:1 matching from SFF, over half of which has yet to be claimed! This is real counterfactual matching: whatever doesn’t get matched by the end of Dec 31, we don’t get. 🧵

intelligence.orgMIRI's 2025 Fundraiser - Machine Intelligence Research InstituteMIRI is running its first fundraiser in six years, targeting $6M. The first $1.6M raised will be matched 1:1 via an SFF grant. Fundraiser ends at midnight on Dec 31, 2025. Support our efforts to impro...

Malo Bourgon reposted

Should be a fun conversation. I'll be there, if you're in town come say hi!

MIRI@intelligence.org

🗓️ Next Friday Sept 26th in DC at @politicsprose.bsky.social (The Wharf) Join us for a conversation between co-author Nate Soares and @jonatomic.bsky.social, Director of Global Risk at the Federation of American Scientists. Audience Q&A, book signing, and more: politics-prose.com/nate-soares

This was a great event. Really enjoyed chatting with Joel and Ollie on the first panel. Thanks @scientistsorg.bsky.social and @futureoflife.org for putting this event together.

Federation of American Scientists@scientistsorg.bsky.social

Dear diary, we had a great time on the Hill last week with our friends at @futureoflife.org We kicked off our AGI x Global Risk day with remarks from @repbillfoster.bsky.social, @reptedlieu.bsky.social, and John Bailey — setting the stage for a day of bold dialogue on the future of AGI 🌎

Should be a fun conversation. I'll be there, if you're in town come say hi!

MIRI@intelligence.org

🗓️ Next Friday Sept 26th in DC at @politicsprose.bsky.social (The Wharf) Join us for a conversation between co-author Nate Soares and @jonatomic.bsky.social, Director of Global Risk at the Federation of American Scientists. Audience Q&A, book signing, and more: politics-prose.com/nate-soares

I really quite like the stories/parables at the start of most chapters, and lots of folks who have read advance copies, from policymakers to folks in the media, have told us they really liked them too. E.g., from someone in the media:

MIRI@intelligence.org

🎧 Audiobook sneak peak from @hachetteaudio.bsky.social From the book's intro: “We open many of the chapters with parables: stories that, we hope, will help convey some points more simply than otherwise.” Here's a snippet of one of them from the beginning of Chapter 1. (Extended clip in 🧵)

Malo Bourgon reposted

Want to read “If Anyone Builds It, Everyone Dies” before everyone else? The Goodreads Giveaway for Eliezer Yudkowsky and Nate Soares' new book is live through Aug 31st. 50 hardcover advance reader copies available (US)! Enter here: www.goodreads.com/giveaway/sho... #BookSky #GoodreadsGiveaway

Feels like it would be a fun mini coding challenge to figure out how to make this happen on purpose.  How does something like this happen by accident? Why is there any code in the app that would vertically mirror text labels? Multilingual support gone awry somehow?

Malo Bourgon@malo.online

“Update available” notification I got in the ChatGPT Mac app today. 🙃

Malo Bourgon reposted

Senior White House officials, a retired three-star general, a Nobel laureate, and others come out to say that you should probably read Eliezer Yudkowsky and Nate Soares' "If Anyone Builds It, Everyone Dies".