> There has been plenty of research that shows LLMs encode social biases.
At the risk of stepping into a hornets nest: is that different than "knowledge"?
Or maybe, what would it mean if an LLM had no social biases? (Would we ever agree that was the case?)
Correct. They will never not have a social bias. Which leads to the question of, who controls these tools, and what biases are they okay/not okay with specifically training for. Currently they can be seen more as a reflection of broader culture (and even that has problems) but as we're already seeing with Grok they can be tuned at a whim to display any specific ideologies.
[dead]
Yes, it would be extremely bad if the statistical weight of the total corpus of training data caused a system using an LLM to make decisions about extending credit to offer worse terms (say) to women.