alt Hacker NewsI read one characterization which is that LLMs don't give new information (except to the user learning) but they reorganize old information.
Replies
docmechanic • 04/23/2025
That’s only true if you tokenize words rather than characters. Character tokenization generates new content outside the training vocabulary.
➕ show 3 replies
Custodians of human knowledge.