logoalt Hacker News

Bias Compounds, Variance Washes Out

24 pointsby jxmorris12last Friday at 11:26 PM16 commentsview on HN

Comments

jstanleytoday at 7:22 AM

This post exhibits a specific LLM tell that I haven't seen mentioned before. It's the style where inanimate objects or concepts are treated as actors, using verbs as if they were actually the one doing something.

* bias compounds

* variance diffuses

* configs store parameters

* BF16 + RNE (6 bytes) plateaus

* errors repeat

* six bytes match ten

This sort of thing reads really well and conveys the idea in very few words. It's good writing! But in my experience humans don't generally "let nouns verb" as much as LLMs do, maybe we're just not as clever with words.

show 5 replies
nnevodtoday at 7:50 AM

This feels very much like dithering. I am no expert by far, so I'm likely missing something.

show 1 reply
ongytoday at 6:38 AM

Gotta admit, I was expecting some hiring/Social biases topic.

This was quite interesting though. Surprised to see it work so well on a real example.