I feel like, to different degrees, we’re witnessing the same effect seen in image generation or text generation. People who don’t know better about art or writing would be impressed by what gen AI can produce and will find it indistinguishable from a human-produced equivalent. This admittedly is good enough for most business endeavors that cared only about the process, and would gladly avoid the cumbersome (to them) process that leads there. But art or writing is not just about the product as much as it is about the human process itself. That is true for all creative forms, even the ones that are normalized in business. Now with the advancements of the frontier models, we’re seeing this in growingly complex fields like mathematics. It does seem to produce results, but the process is equally important. Yet we pretend to measure its ability only based on the result. It’s as if these tools grow to become better at pretending to be top of the crop in increasingly complex fields, which makes it harder and harder for people that actually have a deep grasp of those fields to explain why that’s not exactly what’s going on.