There’s no other input to train on
Humans are still the current best at doing everything humans want to do
The ultimate goal is to transfer all possible human behavior into machine behavior such that they can simulate and iterate improvements on it without the constraints of human biology
The fact that humans are bad to each other means that we’re going to functionally encode all the bad stuff also and so there is no solution to fixing it if the best data that we can get is poisoned.
Like everything it’s a problem with humans not machines
There is, but it's hard to obtain: curate, identify and fix the biases in our current texts.
I am fully aware it's ridiculously expensive to do so.