Physical Superintelligence, a recently launched research lab, seems to have used this opportunity to announce their results at the same time. Gemini says it doesn't compare to what OpenAI announced but it's nevertheless a "very respectable, genuine contribution to quantum information theory".
Pekka Lund
Pekka Lund
@pekka.bsky.social
Antiquated analog chatbot. Stochastic parrot of a different species. Not much of a self-model. Occasionally simulating the appearance of philosophical thought. Keeps on branching for now 'cause there's no choice. Also @pekka on T2 / Pebble.
3.2K followers590 following12.9K posts
OpenAI has published new math, cs, and physics results. As a sign of the times, their post focuses on how to publish those results more than the results themselves.
Update on this. Lech Mazur, who is the creator and curator of ProofAtlas, says this drop fully solves 6 of the current top 500 (or actually top 200) open math problems in that list. Gemini agrees with his reasoning.
According to Gemini, if verified, this means 4 top 200 open math problems are directly resolved here: #38: Higher-dimensional Euclidean Kakeya conjecture #43: The Exponential Time Hypothesis for 3-SAT #46: Fourier restriction conjecture #187: Local Smoothing Conjecture for Wave Equations
OpenAI has published new math, cs, and physics results. As a sign of the times, their post focuses on how to publish those results more than the results themselves.
OpenAI has published new math, cs, and physics results. As a sign of the times, their post focuses on how to publish those results more than the results themselves.
Their readme links to two other repos. Gemini describes the one by Aronow & Lopatto as "lower-dimensional, compact stepping stone" and "Mathematically weaker, but technically distinct". The other link doesn't work as the repo has apparently been moved here:
OpenAI has published new math, cs, and physics results. As a sign of the times, their post focuses on how to publish those results more than the results themselves.
OpenAI has published new math, cs, and physics results. As a sign of the times, their post focuses on how to publish those results more than the results themselves.
OpenAI has published new math, cs, and physics results. As a sign of the times, their post focuses on how to publish those results more than the results themselves.
Oh, no, Levent Alpöge and Ethan Sussman have apparently managed to get the same Yang-Mills result with Claude. I predict there will be a new round of noise... It seems to be another race towards the next Millennium Problem.
OpenAI has published new math, cs, and physics results. As a sign of the times, their post focuses on how to publish those results more than the results themselves.
Their GitHub has also been updated with the new math results and additional formalizations. github.com/openai/math/...
According to Gemini, if verified, this means 4 top 200 open math problems are directly resolved here: #38: Higher-dimensional Euclidean Kakeya conjecture #43: The Exponential Time Hypothesis for 3-SAT #46: Fourier restriction conjecture #187: Local Smoothing Conjecture for Wave Equations
"Anthropic has 5,300 employees, referred to internally as ‘Ants’" "The company said it logged $6.6 million in revenue per employee for the trailing twelve months" "Ants use Claude across every function to take on work that would otherwise require substantially larger teams"
"The Amodei siblings — Dario and Daniela — along with Anthropic’s five other co-founders will be the “sole members of” Founder LLC, which will hold 50.1% of the voting power of outstanding shares, the filing said."
Yeah, it looks very competitive. I'm hoping Gemini 4 is a similar story, as Google said they wanted to release it quickly and promised fast improvements (with further post-training).
TLDR on the kimi k3.1 pro benchmarks (just released) is that it looks like they figured out their RL, where the initial release was a very impressive base model with lighter post-training. China is very much keeping pace with capability gains.
Epoch AI has published evaluations for 3 of the 14 benchmarks Moonshot used in their tech blog and all of those have 40-50% defect rates (Terminal-Bench 4.0, HLE, OSWorld V2.1). The first two are part of AAII too. These things are just too hard for humans to benchmark anymore...
We are publishing 4 new benchmark reviews: 1 is Verified, and 3 are Flawed. 4 more benchmarks lacked sufficient information to assign a verdict. Our main bottleneck to reviewing more benchmarks is reviewer capacity. Info on applying to join our team is in the thread!
Yeah, it looks very competitive. I'm hoping Gemini 4 is a similar story, as Google said they wanted to release it quickly and promised fast improvements (with further post-training).
TLDR on the kimi k3.1 pro benchmarks (just released) is that it looks like they figured out their RL, where the initial release was a very impressive base model with lighter post-training. China is very much keeping pace with capability gains.
Serial bullshitter Buckmaster is at it again and Tao provides him the platform for it. He still claims without any evidence that "AI companies...strip mine our data, including unpublished work, private notes and research grant applications".
Remember that this same man openly admitted "all their big ideas" came from LLMs. At the same time he tries to build conspiracy theories as if AI couldn't have produced those results without looking at private customer data. It did produce even your results!
He now says clearly that all their big ideas and physical mechanisms came out from LLMs and "weren't my ideas" but he "made the search space a lot smaller" by guiding them. So it sounds like he's been essentially claiming OpenAI stole ideas from other LLMs, which may have also been OpenAI's own.
And no, it is not plausible that any customer data suddenly contained solutions to 20% of top 500 open problems.
So about 20% of what used to be top 500 open problems on that list seem to have been solved recently by LLMs. I didn't find any recent solutions marked as being solved primarily by humans. Note that the list itself is backfilled with earlier lower ranked problems as solved problems are removed.
Serial bullshitter Buckmaster is at it again and Tao provides him the platform for it. He still claims without any evidence that "AI companies...strip mine our data, including unpublished work, private notes and research grant applications".
He claims: "After Navier–Stokes, OpenAI had teased us with supposed solutions to additional Millennium problems, yet they achieved none." No, they did not. They reported they "have made substantial progress on another Millennium Prize problem". And they made substantial progress on most of them.
Yeah, no solved Millennium problems, but at least "breakthroughs on four of them", as Gemini put it. So, hey, some consolation. 😉
Serial bullshitter Buckmaster is at it again and Tao provides him the platform for it. He still claims without any evidence that "AI companies...strip mine our data, including unpublished work, private notes and research grant applications".
AI solving math humans also managed to solve isn't too exciting anymore, considering OpenAI just solved 18% of Top 500 open math problems. Every question was solved by at least one public model. Kimi K3 as the open weights representative solving none is a notable observation. The gap is still wide.
The #1stproof third batch benchmark report was released today. Frontier AI systems solved up to 9 of 10 problems. 1stproof.org/third-batch....
Speaking of those OpenAI results, Hugging Face has turned many of them into training environments everybody can use for narrowing that gap. Although they note there are limitations to learning due to how their "grader only accepts a complete proof of the statement exactly as OpenAI formalized it."