logoalt Hacker News

grzraczyesterday at 11:27 AM3 repliesview on HN

Absolute insanity to see a coherent text block that takes at least 2 minutes to read generated in a fraction of a second. Crazy stuff...


Replies

pjc50yesterday at 11:37 AM

Accelerating the end of the usable text-based internet one chip at a time.

VMGyesterday at 12:35 PM

Not at all if you consider the internet pre-LLM. That is the standard expectation when you load a website.

The slow word-by-word typing was what we started to get used to with LLMs.

If these techniques get widespread, we may grow accustomed to the "old" speed again where content loads ~instantly.

Imagine a content forest like Wikipedia instantly generated like a Minecraft word...

kleibayesterday at 11:41 AM

Yes, but the quality of the output leaves to be desired. I just asked about some sports history and got a mix of correct information and totally made up nonsense. Not unexpected for an 8k model, but raises the question of what the use case is for such small models.

show 2 replies