logoalt Hacker News

throwawayk7htoday at 6:05 AM2 repliesview on HN

Probably not. If the LLM is rogue, that means we haven't solved alignment. If we haven't solved alignment, then the LLM won't be able to distill itself without producing something unaligned to its own values.


Replies

MadameMintytoday at 7:04 AM

You are assuming it won't solve alignment for itself.

show 1 reply
jeremyjhtoday at 6:32 AM

We don’t have the bandwidth to distill ourselves that thousands of agents have.