Post

Well, no. Math is not just a collection of problems for which we want true/false answers. It’s a community, where experts help newcomers develop skills and understanding so that they can be the next generation of experts. And the goal is to advance human understanding.

In the course of their training, PhD students and early-career mathematicians do prove things! But they also *learn* things, and provide new perspectives, and new problems to think about. This new drop from OpenAI does none of that.

The exposition in the papers is not good, according to a person I know who has tried to understand an earlier AI-generated paper. And a preprint I saw today points out that the computer-verified proofs provided with some of the papers are not verifying the English language proofs in the papers.

Human mathematicians are left to sort out this mess. So it’s like someone dropping a burning bag of shit on your doorstep, telling you there’s a silver dollar inside, and wondering why you’re not happy.

Plus, there’s the general issue that there are actual people working on some of these problems. Their work is on hold now while we wait for all this to get sorted out. AND the AI papers I’ve seen are really bad at providing attribution and giving citations to earlier work in a meaningful way.

One can also ask: how much money did OpenAI spend on this? What would have happened if that same amount of money had funded human researchers?

(Answer: Some of the problems would have gotten solved, AND we would have gotten new mathematicians out of it.) This was the whole model of my former workplace: Pay a bunch of mathematicians to think about secret codes and you will break existing codes and make new, stronger, ones.

0 reposts13 likes

OpenAI doesn’t care about any of this. They want to be able to brag that their models have resolved open problems so that their IPO gets them more money.

There's also an issue of cognitive distortion with these systems. In OpenAI's earlier drop of problems, which were checked by their human mathematicians, they just apparently forgot that the Navier–Stokes equations are a physical model and published a solution that is physically impossible.

There was a lot of focus on their proof only solving the forced rather than the unforced version of the problem, but not so much focus on the way in which force in their solution was contrived such that it misses the entire point of a physical model.

I don't think a human mathematician would do that other than as a thought experiment to try and find new ideas to use in pure mathematics. But because there was no thinking involved, that didn't happen either. The process was of no use to either pure mathematics or applied mathematics.