alt Hacker News> LLM's are notoriously bad at this. The noise to signal ratio is unacceptably high…
I keep seeing this statement in threads about AI, and maybe it’s just from you, but high SNR is a good thing.
See https://en.wikipedia.org/wiki/Signal-to-noise_ratio
I think the rest of your post is very valid. It’s the mental equivalent of this article https://news.ycombinator.com/item?id=47049088
Replies
Hah, you got me there! I'll try to keep the ratio flipped correctly next time ;)
I read that article recently, so the similarities might not be entirely coincidental. 'JPEG of thought' is gonna stay in my vocabulary for a while.
Hehe, yeah there's some terms that just are linguistically unintuitive.
"Skill floor" is another one. People generally interpret that one as "must be at least this tall to ride", but it actually means "amount of effort that translates to result". Something that has a high skill floor (if you write "high floor of skill" it makes more sense) means that with very little input you can gain a lot of result. Whereas a low skill floor means something behaves more linearly, where very little input only gains very little result.
Even though its just the antonym, "skill ceiling" is much more intuitive in that regard.
Except they didn't say signal-to-noise, they said noise-to-signal. And if the NSR is unacceptably high, that means the SNR is unacceptably low.
Two inverses do make a right, it seems.