alt Hacker NewsYeah and it's degraded significantly since then. Older llms were still mostly language focused and had a lot of latent knowledge about things like writing styles. Now it's crowded out in favor of agenetic work, programming etc.
Replies
conception • today at 4:11 AM
I’m surprised no one has distilled a 4o model yet that’s really good at prose. No money from enterprise users I suppose.
No, the latent knowledge is larger than ever, as verified by many benchmarks (and instances like people being shocked by truesight of obscure forum posters). This is 100% a chatbot personality/alignment/post-training thing.