logoalt Hacker News

junontoday at 3:46 PM2 repliesview on HN

This would be expected. The corner cases people faced with PHP throughout the decades have been well documented on the internet for eons.

Swift, not so much. It's relatively new. Looking at AI's abilities like an engineer's career span scaled about 10-20x of time makes it make a bit more sense.

It's going to be worse at newer/niche things, intuitively - which is only going to get worse as it "learns" from garbage outputted by other LLMs moving forward.


Replies

ChrisMarshallNYtoday at 3:54 PM

Also, I suspect most "production" Swift –the type of stuff written by seasoned experts– (I just had to add em-dashes ;) is behind closed-source walls.

show 1 reply
red75primetoday at 4:03 PM

> which is only going to get worse as it "learns" from garbage outputted by other LLMs moving forward

You seem to assume that autoregressive pretraining (and unfiltered behavior cloning, maybe) are the only ways to improve LLM performance.