The exams need to change. Now that we have LLMs the value a human can bring to a task has changed and it’s that new value that has to be tested.
It’s like testing your drawing ability in a photography class. The difference is that now nearly have subject and testing method we have has become obsolete. Drawings courses still exist as will traditional courses, but the main stream has changed and exams and schools need to adapt.
Terrible comparison. You don't need to be good at drawing to be good at photography.
You do need to be good at math to do e.g. physics (or math itself!), nomatter the tools at your disposal.