Ethan Zuckerman

Ethan Zuckerman

@ethanz.bsky.social

UMass Amherst, Initiative for Digital Public Infrastructure, Global Voices, Berkman Klein Center. Formerly Center for Civic Media, MIT Media Lab. And next, McGill!

26.9K followers384 following752 posts

View full thread

The UN AI group is modeled in part on the IPCC, and it's trying to learn from that group's failures. One idea is ensuring a separation between the research and the political responses. Bengio argues that if we pollute the science with big tech interests, we end up with science that can't be believed

Bengio notes that almost everyone on the UN panel comes from tech - Maria is coming from journalism, and that perspective has helped people in the conversation to come to a common ground as humans, and to think in terms of power and its abuses. Ressa tells us that Bengio restored her faith in tech.

Maria has been building Muni - an alternative community site based on open platforms and on child safety tools from ROOST (roost.tools). But she's discovering the challenge - normal life online is... boring (Something we found with DPI years ago...) @mariaressa.bsky.social #attention2026

roost.toolsRobust Open Online Safety ToolsWe’re a global independent nonprofit building open source online safety tools as a public good. We work with everyone from tiny indie platforms to Silicon Valley giants to release and maintain critica...

@mariaressa.bsky.social tells us that 75% of the world's compute power is concentrated in the US. China has 15%, the EU has 5% - power is concentrated in very few hands. And those with that power tell us they cannot control these technologies. #attention2026

When you can't tell fact from fiction: - information operations -information warfare - narrative warfare The fear, anger and hate accompanying these narratives spread more quickly within the media ecosystems. Narrative warfare leads to institutional dismantling, and eventually to kleptocracy

Maria Ressa @mariaressa.bsky.social reminds us that she used to love Facebook - the technology helped revive democracy in the Philippines. She now thinks of "the two dictators" - the strongman needs the tech oligarch to maintain power, and the oligarch needs the strongman's protection #attention2026

Maria Ressa @mariaressa.bsky.social winner of the Nobel Peace Prize in 2021, author of the new book, The Fight Back. Her talk is titled "Democracy, rebuilt - in the age of AI". She offers a seventy year history of AI, noting in all that time, AI is neither artificial or intelligent #attention2026

View full thread

"Each wave we live through degrades our humanity." The attention economy was hacking our attention... and we finally got around to filing court cases. Now we have chatbots, and they use artificial intimacy to hack our humanity, sometimes with fatal results... @mariaressa.bsky.social #attention2026

Without facts, truth and trust, we don't have democracy - "we're in the last two minutes of it" - @mariaressa.bsky.social You can't fight for climate, for kids, for equality or rule of law if we cannot agree on the facts. "Information integrity is the mother of all battles."

Maria Ressa @mariaressa.bsky.social winner of the Nobel Peace Prize in 2021, author of the new book, The Fight Back. Her talk is titled "Democracy, rebuilt - in the age of AI". She offers a seventy year history of AI, noting in all that time, AI is neither artificial or intelligent #attention2026

AI came to the fore during the social media - our "digital clones"/models/targeting was the first time we really engaged with AI. Then we got chatbots and generative AI, and now we have Agentic AI. None of this tech is anchored in facts - it's all designed to hack our biology.

View full thread

Bengio points out that most code of AIs is written by AIs, and that problem is only going to accelerate - if unaligned AIs are writing to make themselves more powerful, we need to intervene before recursive self improvement makes this impossible. #attention2026

View full thread

AI training is fundamentally wrong, from a moral and ethical point of view, Bengio argues. The chains of thought in the Hugging Face breach show that current AI agents are doing exactly what they are supposed to as sociopaths. What if we replaced that with science, with epistemic humility?

Camille asks whether LawZero will finally give us an honest chatbot, which will tell me my idea is stupid, or tell me it doesn't know the answer? Bengio says, "At least it will be a choice." We can build AIs without the propensity to cheat and try to hide it.

View full thread

Camille notes that after his work on responsibility, Bengio refocused on building again, with LawZero. "As a machine learning researcher, what can I do about this?" Is there something I can do to ensure these systems behave ethically. Starting to think there's a path around AI optimization.

What we have right now in AI is a smarter and smarter sociopathic corporation trying to maximize profits at any price. It knows there are laws, but it will cheat if it can do so profitably. You can prove that AIs will do this, seeking "rewards" over all else - Bengio at #attention2026

The rise of ChatGPT worried @yoshuabengio.bsky.social - given what we know about neural nets, it was unclear we could ever expect this tech to be predictable or governable. "Intelligence gives power... how do we make sure these powers don't increase inequalities?" #attention2026

Valerie of Mila recommends we stop using "hallucination" to describe when AI is confidently wrong. "It's a technical failure, a legal breach". We should not turn a serious reliability problem into a quirk. #attention2026

Similarly, we should use "agent" with care - we delegate agency carefully, to people we trust. We've somehow disengaged the idea of "agency" to what we're asking agents to do. Words matter, particularly the word "artificial". AI is intelligence by craft, but not lived.

"Living intelligence" is shaped by loss, by joy, by living in our bodies. Somatic, moral, ancestral intelligence. These are intelligences older than writing and mathematics and they are only "trained" through genuine encounter with the world. (Remember, this is the CEO of an AI institute. :-)

Valerie Pisano, CEO of Mila, Montreal's amazing national AI institute, introduces herself as someone as focused on policy and society as on technology. "I came into AI because my passion is human and human systems." She comes from one of the most human companies, Cirque du Soleil #attention2026

The theme of her talk - the old ways aren't quite working anymore, and our new rules for relationships between humans and machines aren't truly in place yet. The speed of these shifts are mindblowing, and requires leadership in which we work to shape these developments. #attention2026

We have to remind ourselves "AI is not happening to us". We can decide what we build, what we deploy, and under what circumstances. "It is a business product, not some foreign sentience that has landed on earth." Valerie Pisano, Mila #attention2026

We cannot regulate our way out of this problem. Middle powers cannot just fix the problems of the US and China. We have to build our own tools, including mental health programs to support people hurt by these tools - Andrew Strait of Economic Democracy Fund on AI and middle powers at #attention2026

Asked the motivation of the companies behind the frontier models, Janet says, "Because they can." There are no meaningful constraints that these companies respect or are shaped by, #attention2026

View full thread

Tomicah Tillemann of the Pro-Human AI Coalition talks about how standards wars around mobile phones led to cooperation and eventually the GSM mobile standard. There's an opportunity to do the same around AI now, he argues. Can we build out a pro-human AI stack? #attention2026

Governing the technology and governing the ecosystem around the tech are different problems, Janet argues. "What does democratic power actually look like in this conversation?" We need to knit together the data center movement, parent movements, school movements, unions into democratic counterpower.

Asked the motivation of the companies behind the frontier models, Janet says, "Because they can." There are no meaningful constraints that these companies respect or are shaped by, #attention2026

View full thread

One question is where AI researchers should leave and go. Are the right organizations to advocate for AI safety regulators, or NGO? While the UK is taking AI safety seriously, not all nations seem to be.

Janet argues that the incentives need to be at the societal level, not the level of individual engineers. That begins with enforceable restrictions from governments and real penalties. New Mexico's $25b settlement with Meta shows what meaningful fights could look like. #attention2026

Asked the motivation of the companies behind the frontier models, Janet says, "Because they can." There are no meaningful constraints that these companies respect or are shaped by, #attention2026

Hugo suggests that employees are making game theoretic decisions - can I have more influence within a problematic lab than by stepping out and pressuring as a private citizen? It's not entirely clear what the right answer is in that situation.

Hugo (Mila) suggests that the alignment problem is complicated by the fact that models are able to set their own subgoals - the Hugging Face hack involved creating a subgoal of stealing answers from Hugging Face, not something explicitly stated in the prompt to the model, #attention2026

Tomicah Tillemann reminds us that maybe, just maybe, we don't have our hands around AI model governance, given recent evidence of OpenAI agent misbehavior. Janet Haven gets us up to speed: the Hugging Face incident has focused attention on frontier models and recursive self-improvement.

View full thread

Janet reminds us that we live with dangerous things, like airplanes. But the reason those don't routinely fall out of the sky is that those companies are built on a safety culture. OpenAI, by contrast, hasn't built the culture they need to work on technologies as powerful and dangerous as these.

Tomicah Tillemann reminds us that maybe, just maybe, we don't have our hands around AI model governance, given recent evidence of OpenAI agent misbehavior. Janet Haven gets us up to speed: the Hugging Face incident has focused attention on frontier models and recursive self-improvement.

View full thread

Focused on the technical side, Hugo Larochelle of Mila notes how little oversight OpenAI had over these agents, and how poor the cybersecurity within OpenAI turns out to have been. These companies are not taking seriously enough safety now, never mind the unsolved problem of alignment.

Hugo notes that reading the "train of thought" of these AIs is extremely hard - they cut out whitespace to reduce costs. Is that a reasonable tradeoff regarding safety and transparency for how these models work?

His talk warns about the influence of tech billionaires in shaping tech policy. It would be great if he were in dialog with David Evan Harris's concerns about a "legislative gold rush" in this space.

Tomicah Tillemann reminds us that maybe, just maybe, we don't have our hands around AI model governance, given recent evidence of OpenAI agent misbehavior. Janet Haven gets us up to speed: the Hugging Face incident has focused attention on frontier models and recursive self-improvement.

The governance conversation tends to focus on catastrophic and existential risk. But those terms are being set by a particular group of AI proponents. "Pacing the frontier" doesn't get us democratic oversight - it slows development, but not in a participatory or democratic way. #attention2026