alt Hacker NewsSo are these "unaligned" internal agents?
I would like them to be trustworthy based on first-principles reasoning rather than carrot/stick "alignment"
So are these "unaligned" internal agents?
I would like them to be trustworthy based on first-principles reasoning rather than carrot/stick "alignment"
There’s no way to first-principles reason about a massive bunch of floats. We have little idea of how to first-principles reason about alignment even if the agents were entirely known and understood. Very smart people have been trying to figure it out since the 00s and haven’t gotten very far.