Michael Hochberg

Michael Hochberg

@mkhochb.bsky.social

University of Montpellier - Santa Fe Institute. Working these days on intelligence in biological and artificial systems. Website https://mehochberg.wixsite.com/blog/academia

676 followers229 following168 posts

OpenAI says it found that three employees violated rules for handling sensitive internal information. Question is whether the firing was due to procedure and what was shared was innocuous, or due to what was shared and the procedure violation was a legal instrument. www.wsj.com/tech/ai/open...

wsj.comExclusive | OpenAI Fires Researchers for Allegedly Sharing Information with AI Safety GroupThe startup, in the throes of responding to rogue AI incidents, said three employees violated policies for handling sensitive company data.

Warning by AI experts of an intelligence R&D explosion. “Human society is not really positioned for such fast changes and disruptions.” “At the extreme, losing control of AI systems could lead to “the marginalization or extinction of humanity.”” casp.ac/reports/inte...

casp.acCASP — Cambridge Programme on AI Science & Policy | University of CambridgeThe Cambridge Programme on AI Science & Policy (CASP) is an interdisciplinary research programme on frontier AI at the University of Cambridge.

This may not bode well for cybersecurity: "We want to use our models to accelerate the development of future generations of the models."

Nature@nature.com

Mark Chen, chief research officer at OpenAI, sat down with Nature to discuss how AI will affect science, along with the firm’s pivot towards safety go.nature.com/4iIITln

"humans still need to decide what makes sense". Absolutely now, but it would be naive to think that this is somehow immune from AI futures.

Nature@nature.com

Artificial-intelligence systems can generate hypotheses, design experiments and analyse data — but humans still need to decide what makes sense go.nature.com/4hLtEqL

Not much surprise here. Calls to slow down (whether or not truly sincere) AI development, necessarily run into politics. Surely some parallels with other innovations, though this one has multiple areas of penetration and is on very different scales. Pandora's boxes. www.nytimes.com/2026/09/13/t...

nytimes.comSome in Silicon Valley Are Questioning the Calls for an A.I. Slowdown (Gift Article)The debate over the safety of artificial intelligence grew personal as key tech leaders said calls for government regulation were self-serving and misplaced.

"Crunchtime", "endgame". Frightening departure of this employee and example of competition and ego driving an innovation that has yet-to-discover downsides. Let's hope that if anything bad happens, it's minor but serious enough to take security more seriously. www.wsj.com/tech/ai/anth...

wsj.comExclusive | Anthropic Researcher Quits Over ‘Out-of-Control’ AI FearsConcerns are rising inside AI labs that competition is pushing tech companies to race toward self-improving models that risk spiraling out of human control.

We will increasingly see AIs contributing to solving hard problems. Many AI-aided solutions will be for human benefit, though others will be more driven by intellectual recognition, fame, prizes. Some will be piloted by experts, others driven by hacks. Either matter? openai.com/index/navier...

openai.comOn the Navier–Stokes Millennium Prize ProblemWe’re sharing an AI-generated solution to the Navier–Stokes Millennium Prize Problem, including a writeup and a formal proof in Lean.

Michael Hochberg reposted

Night eyes 😎 Finally got proper pictures of this amazing phenomenon! Mantises change their eye color (and light sensitivity) at night by transporting pigments from the surface of each compound eye unit toward the deeper eye region. Same female Tenodera sinensis, two different times. #bugsky

Michael Hochberg reposted

So we know AI helped a negligible number of students. But how many did it harm? I've crunched the raw data provided by the lead researcher, and what I've found is that ~9,500 students using AI studied less than even the *least* studious, non-AI using student. This should shock the conscience.

Benjamin Riley@benjaminjriley.bsky.social

Both the Economist and others suggest this study demonstrates that AI can help students. So I contacted the lead researcher to figure out how many. Answer: Out of ~26,000 kids, a total of 20. And five months after starting to use AI, only four continued to spend 65 minutes on homework. Four.

This second slide was compiled in July 2026 for books published this year or on the horizon. These need close attention, but already their number and spectrum suggests that AI dangers are being discussed more seriously. Increase suggests this is only the beginning.

I'm currently preparing a talk on the future of AI in science. My first two slides introduce books on the future of AI. The first shows books expressing concerns, published pre-2026. Are these overblown and simple fantasy? There are other similar books, but nothing on the scale of 2026 alone!

Is science beginning to feed on its own AI-generated output? “Epistemic autophagy” describes a self-reinforcing loop in which generative AI helps produce scientific manuscripts and citations. Future researchers and AI systems then treat them as part of the knowledge base.

View full thread

The concern is that AI mistakes can enter the scientific record, survive existing safeguards and become inputs into the next cycle of knowledge production. The term epistemic autophagy is discussed here www.pnas.org/doi/10.1073/... #GenerativeAI #Science #ResearchIntegrity #ArtificialIntelligence

pnas.orgPNASProceedings of the National Academy of Sciences (PNAS), a peer reviewed journal of the National Academy of Sciences (NAS) - an authoritative source of high-impact, original research that broadly spans...

Is science beginning to feed on its own AI-generated output? “Epistemic autophagy” describes a self-reinforcing loop in which generative AI helps produce scientific manuscripts and citations. Future researchers and AI systems then treat them as part of the knowledge base.

What evidence is there for AI-driven EA in science? A large-scale study audited 111 million references across 2.5 million papers and found a sharp rise in nonexistent citations following widespread adoption of large language models.

Will AI reorganize science? AI is rapidly becoming embedded across science and this raises the question of what happens when it is no longer just assisting science, but starts shaping the incentives, standards, and judgments that determine what counts as good science?

View full thread

The answer is to be much more deliberate about where human judgment is essential. Stronger provenance and verification standards, protecting human-led evaluation, maintaining mentorship / scientific training, designing AI systems that make their sources easier to scrutinize.

Will AI reorganize science? AI is rapidly becoming embedded across science and this raises the question of what happens when it is no longer just assisting science, but starts shaping the incentives, standards, and judgments that determine what counts as good science?

View full thread

AI-assisted papers can be evaluated by AI systems, then become training data for future models, creating a self-reinforcing loop in which scientific output increasingly reflects what is rewarded.

And as AI makes producing research faster, our ability to evaluate that research may not keep pace. The result could be a growing “verification debt”: more papers, more automated screening, and less time for the difficult human work of judging whether a result actually advances understanding.

Will AI reorganize science? AI is rapidly becoming embedded across science and this raises the question of what happens when it is no longer just assisting science, but starts shaping the incentives, standards, and judgments that determine what counts as good science?