Are they fully “doing math” in an aligned way though? They are finding mathematical proofs, which is important, but contextualizing results in the prior literature and clearly communicating the approach and implications is just as much part of mathematical research.

You might argue that these aspects of math are less important in the new AI accelerated math world, because agents will inevitably be smarter than humans, but I think clear framing and communication is even more important than before because with this technology we can choose to augment our intelligence instead of defer it

write down "LLM's will cure cancer" on sticky note, put it on your desk and recite that every day, a hundred times and in the bathroom if you have to