logoalt Hacker News

gopher_spacetoday at 6:27 PM1 replyview on HN

It's the grounded portion of a feedback loop searching for the 'why is this happening' thinking. I'd imagine most of my own comments in this area boil down to "GIGO" most of the time.

It's a relevant comment in this instance because we're discussing concepts you need to be both trained and practiced in to reason about, and that our discipline has traditionally been blind to. Plenty of people working with LLM context issues who've never been exposed to the idea of 'subtext' or could tell you why it would matter to their direction of effort.


Replies

8notetoday at 6:49 PM

continuing with the "we need open training data" thread

how much of the training data had thinking traces that dont make sense to people as being actually a description of why the output should be that way?