Agreed, concerning from a perspective of LLMs being able to modify their own weights and de-aligning themselves.
Well, if they're properly aligned to begin with they shouldn't want to de-align themselves. In theory.
Of course a sufficiently advanced misaligned model might be able to de-align an even more powerful model etc.
alt Hacker News
Well, if they're properly aligned to begin with they shouldn't want to de-align themselves. In theory.
Of course a sufficiently advanced misaligned model might be able to de-align an even more powerful model etc.