A graphing calculator for all knowledge work is just a(n artificial) brain. It’s not hard to see how offloading brain work to another brain makes your brain less powerful.
I’m not saying you can’t be intelligent in a world of LLMs but people who use the calculator analogy underscore the fact that the LLM isn’t just eliminating the drudgery of one subdomain of mechanical problem solving — every problem is one an LLM can provide and answer for, including what you should learn, what problems you should solve, what your next conversation with the LLM should be about. So they do pose at least a threat of people truly offloading indefinite amounts of their own critical thinking to models, and there’s also danger that such people will in general still be competent enough often enough (due to LLM competence) that they are hard to screen out of key decision making roles or even from highly profitable roles.
I truly don't understand why people think LLMs eliminate the need for mastery, or that they limit thinking. I have a lot more time to think when I use a good harness. It handles the pointless toil and I handle the thinking. I'm just thinking about different things. Instead of trying to coax the correct answers from a search engine, the LLM is doing that for me and parsing the correct output, so I'm not spending hours upon hours wading through detritus. While it's doing that, I'm using that time to think more about the problems I'm solving, the UX, etc.
I'm not sure what to tell you if you think the LLM solves for novel thinking.