logoalt Hacker News

thevalueisai • today at 4:03 PM • 3 replies • view on HN

The value is proving AI can be useful after all (and we're fucked).

Remember, not too long ago we had hordes of folks here proclaiming machines can't think, reason or be creative in any productive sense. Many still do, but it's starting to look bleaker by the day.


Replies

agentultra • today at 4:22 PM

This is a competent person using a tool in their work.

The tool isn’t doing the thinking or the proof on its own.

It also hasn’t been vetted/verified yet. There’s still work to do.

➕ show 2 replies
ThrowawayR2 • today at 5:14 PM

These AI bros don't get it. These LLM systems solving math problems have the benefit of being constrained by formal rules of math providing constant feedback when they break the rules that prevents them from wandering into la-la land. As Dijkstra said in his prescient "On the Foolishness of 'Natural Language Programming'":

> "The virtue of formal texts is that their manipulations, in order to be legitimate, need to satisfy only a few simple rules; they are, when you come to think of it, an amazingly effective tool for ruling out all sorts of nonsense that, when we use our native tongues, are almost impossible to avoid."

To whatever extent that LLMs can "think, reason, or be creative" in generating these proofs (or writing code), they're aided by very high guardrails so it doesn't say very much about what they can do in broader, fuzzier domains.

➕ show 1 reply
ToucanLoucan • today at 4:27 PM

> Remember, not too long ago we had hordes of folks here proclaiming machines can't think

Machines can absolutely think. It's really all they do.

> reason

Murky, but LLMs prove with an avalanche of statistical modeling, they can do something kind of analogous to reasoning, with the caveat that whatever they output will necessarily have to exist in some fashion in their training data.

> or be creative

Absolutely not. By definition an LLM cannot create original work, it can only remix and recombine what it already knows. That can be interesting, and bloody useful especially for code tasks, but it is not making anything original.

➕ show 3 replies