Why should it change when there's good chance it's just slop? That's exactly the standard that human mathematicians are held to -- and it's their job to refine and polish the work to make it understandable by the community. And standards have evolved that way because otherwise there's too much slop to wade through (eg. you'd be surprised how many papers the typical theoretical physicist gets claiming to have proven Einstein wrong -- from absolute crackpots who don't understand the basics of the subject). This will just multiply now with AI, and doesn't change just because the prompter happens to be on OpenAI payroll.

We'll see what the final slop rate is, but the three papers they retracted yesterday were for a trivial sign error. If they didn't catch that, that means OpenAI isn't bothered to put in the minimum effort of sifting through their own garbage and making sense of it.

It's not like they needed to hurry out this release before carefully vetting. They're just "hacking" the math system and disrupting the work of thousands of researchers to create a gigantic RL dataset for themselves.

Really, what's the bloody hurry?

They could have released 1-5 papers, worked with researchers to understand what methods work and what don't, how to prompt the models better, how to build better guardrails for reasoning, etc. And give those researchers access to latest models and empower then to solve thousands of problems!

Instead OpenAI wants to piss all over the city to claim territory and now human mathematicians have to go around cleaning up that slop, only so that OpenAI can made some bullshit statement like: math is solved [mistakes are next].

--

Imagine someone gave you a million line PR claiming to have vibecoded the operating system of the future (or whatever your application domain). Would you drop all your other work to focus on this? And they generate enough PR that your manager and company leadership and public all start pressing you to accept it quickly? Guess what, it's your lucky day! You have not one, but 700 breakthrough PRs!