logoalt Hacker News

samuelknight • today at 11:21 AM • 1 reply • view on HN

OpenAI is publishing the math because they want mathematicians to read along and verify the work they are doing. The author complained that even the citations don't make a lot of sense. This is completely consistent with my experience of using AI for coding. When I task my agent a hard problem and it comes back with a 5000 line PR that I don't follow I reject it and work it into a better shape. I certainly don't slam it into production because it has a 'high signal' of the program I asked for. The mathematician's situation is a lot worse because they have no view over the process that created the artifact like we do with coding agents.


Replies

simianwords • today at 11:40 AM

> When I task my agent a hard problem and it comes back with a 5000 line PR that I don't follow I reject it and work it into a better shape. I certainly don't slam it into production because it has a 'high signal' of the program I asked for.

??? That's literally what everyone does. You are creating a hypothetical that is nonsensical. Here's your hypothetical:

1. Agent gives you 5000 lines of slop

2. You reject it and just do it yourself

This is reality

1. Agent gives you 5000 lines of slop

2. you realise that it has done a lot of research and is mostly in the correct direction and you ask it nicely to refine it

3. verify that you understood it and push it to prod

Are mathematicians babies that they need a completely different approach?

➕ show 1 reply