The hand wringing is premature. Thus far AI has only shown a superhuman aptitude for brute forcing proof of existence:

- Disproof of the Jacobian conjecture by example

- Construction of a non-sofic group

- Existence of singularity in Navier-Stokes

Mathematical conjectures tend to be universally quantified, especially those conjectures that are used as building blocks (e.g. RH). If anything, AI models are currently performing a useful service by disproving false conjectures, a kind of mathematical weeding.

The good news from the last couple of years of coding agents is that while models have become more persistent and knowledgable, their creativity (defined as being able to escape their training distribution and synthesize completely novel ideas) is improving at a much slower rate.

AI will only become a threat to mathematics if/when it develops the capability for creative big-picture problem solving. If that happens, the impact on mathematics will be a footnote compared to the impacts on society at large, since creativity unlocks a host of new economic capabilities.