alt Hacker NewsTo me the main question is what happens after that..
We all move to frozen open source models running on 2nd hand Oracle/Coreweave GPUs? 10 years before someone dares make another training run?
Culturally, do we all collectively sober up once money dries and hallucination are still here? Pendulum swing, AI consideredharmful moment? How to promote healthy use when cognitive surrender is so engrained in us?
What happens if there's a new GPT2 scale (i.e. not astroturf/mass histeria marketing) breakthrough?
I find that modern harnesses mostly get rid of hallucinations: ask your agent to provide quotes and citations and tests for everything, and have another agent cross check that.
Same way we used to do that as humans: I vaguely remember a case or an anecdote from history, but before I use it in a text, I go and look up whether my memory is playing tricks on me.