logoalt Hacker News

HardCodedBiasyesterday at 5:12 PM2 repliesview on HN

Two claims here:

1) LLMs have failed to live up to the hype.

Maybe. Depends upon's who's hype. But I think it is fine to say that we don't have AGI today (however that is defined) and that some people hyped that up.

2) LLMs haven't failed outright

I think that this is a vast understatement.

LLMs have been a wild success. At big tech over 40% of checked in code is LLM generated. At smaller companies the proportion is larger. ChatGPT has over 800 million weekly active users.

Students throughout the world, and especially in the developed world are using "AI" at 85-90% (from some surveys).

Between 40% of professionals and 90% (depending upon survey and profession) are using "AI".

This is 3 years after the launch of ChatGPT (and the capabilities of chatGPT 3.5 were so limited compared to today that it is a shame that they get bundled together in our discussions). I would say instead of "failed outright" that they are the most successful consumer product of all time (so far).


Replies

baseballdorkyesterday at 5:21 PM

> At big tech over 40% of checked in code is LLM generated. At smaller companies the proportion is larger.

I have a really hard time believing that stat without any context, is there a source for this?

show 1 reply
ipdashcyesterday at 5:40 PM

> At big tech over 40% of checked in code is LLM generated.

Assuming this is true though, how much of that 40% is boilerplate or simple, low effort code that could have been knocked out in a few minutes previously? It's always been the case that 10% of the code is particularly thorny and takes 80% of the time, or whatever.

Not to discount your overall point, LLMs are definitely a technical success.

show 1 reply