logoalt Hacker News

Myrmornisyesterday at 1:07 PM2 repliesview on HN

Sure but the question is why "load" after X?


Replies

bigfishrunningyesterday at 1:19 PM

Because, for some high number of contexts, its likelihood comes out high in the big tree of multiplies that is claude's model. For some sets of 500 words (or whatever), the next word is "load". The classifier that decides which sets of 500 (or whatever) words is a prefix for "load" is returning "true" too often.

bunderbunderyesterday at 1:22 PM

More-or-less the same principle, but scaled up massively, and with context-dependent probability conditioning maps.