Crazy how intelligence is cheap, efficient and commonplace now. We humans better refocusing our energy on our core values/principles, given most of our skills are becoming irrelevant
A counter argument: A strong distinction between "intelligence" (understanding what is) and "values/principles" (understanding what ought to be) was characteristic of much early modern European philosophy from Descartes to Kant, which received its influential strong formulation from David Hume.
But trying to maintain this distinction leads to insuperable difficulties. Our conceptual framework for understanding the world are always value-laden. There is no "view from nowhere", no historically unconditioned set of values or concepts. Your framing, in which "values" are external to "intelligence" and must be imposed on it (on pain of intelligence being "value-neutral"), leads inevitably to the dead end of "AI Alignment", "superintelligence", etc. Which is a kind of pseudo-theology.
"We humans better [be] refocusing our energy on our core values/principles, given most of our skills are becoming irrelevant."
In light of the untenability of a strong fact/value or intelligence/ethics distinction, I would suggest this alternative advice: humans should focus on critical appropriation and extension of the received wisdom, whether that comes to us directly from human beings or indirectly through an LLM. Perhaps this is compatible with the spirit of your original suggestion.
Intelligence on its own is not very useful though. We put it on a pedestal because it creates huge potential when paired with other things, wisdom, discipline, empathy, but on its own?
It's still clear that LLMs lack spatial reasoning, either in the concrete or abstract, and while that sort of reasoning has been downplayed by academia for at least a century it is fundamental to technology and industry. (And many would say for science and mathematics too).
They will, however, get there as well either directly or as interfaces to models that do, and your core point stands.
Everybody can be an armchair mathematician now. Just fling some thoughts in the direction of your AI setup and let it do breadth first search with AI based pruning heuristics.
Iteratively leaning on lean to prove a conjecture is not intelligence, it is automation
Ever heard of the infinite monkey theorem?
This is basically what LLMs do on really hard tasks. Prompt it a million times on a really hard problem and it might output the correct answer once.
how much can I bill for having good core values?
Intelligence was always relatively cheap. You can pick up a phone and get answers for free in most academic settings.
Oh brother
AI hasn’t even taken the class of jobs associated with customer service lmao
yeah...right. Go touch some grass
Once we figure out the pesky problem of how we're going to pay for housing, food, and healthcare.
Mathematics is a human-designed game that involves rearranging symbols.
If it were commonplace, there wouldn't be a post and discussion about it. Cheap? Arguable - while it didn't cost thousands, it wasn't free. Cheap is in the eye of the beholder. Efficient...How do we even measure that? The massive infrastructure and training to take a product to the point where someone could do this is massive. Ignoring everything behind the scenes and acting like one session and result is the whole picture of efficiency doesn't seem right. And no, nothing produced by AI makes skills irrelevant. That is the whole ongoing argument of whether people are losing cognitive ability by moving their thinking to AI.
Overall, this is an impressive proof of capability. But I wouldn't take that proof as anything more than what it is.