logoalt Hacker News

terminalshortlast Saturday at 1:35 AM1 replyview on HN

LLMs even fail on tasks like "repeat back to me exactly the following text: ..." To say they can exactly and reliably reproduce copyrighted work is quite a claim.


Replies

tomschwihalast Saturday at 8:25 AM

You can also ask people to repeat a text and some will fail. What I want to say is that even if some LLMs (probably only older ones) will fail doesn't mean future ones will fail (in the majority). Especially if benchmarks indicate they are becoming smarter over time.