Other than the fact it's mathematicians signing it, why is mathematics special in this regard: surely this generally applies to a lot of different industries and sectors of research / academia?

Mathematics is being used as a benchmark because there are some high-profile awards in this area I guess, and possibly because 2/3 years ago LLMs were pretty atrocious at it so the level of improvement has been significant.