logoalt Hacker News

neuronexmachinayesterday at 9:39 PM1 replyview on HN

What would you consider as sufficient evidence of LLMs being useful in a particular domain?


Replies

GolfPopperyesterday at 11:27 PM

To meet the threshold of "insanely useful"? The Sagan standard is, "Extraordinary claims require extraordinary evidence."

I can see that some people can make some use of them. (This is true of almost everything.) Whether or not that usefulness is worthwhile overall, whether it is a net good, or even ethical is a different question. But insanely useful?

Computers are insanely useful. So are engines. Water. Sunlight. Electricity. Grain and bread. Writing. Printing. And I don't feel bad making those sorts of comparisons, because that's the level of impact LLMs' advocates are promising. But it's not what we have.

What I would consider sufficient evidence for insanely useful? Reliably replace a human in prolonged, arbitrary, detailed interaction, without any inhuman screwups.