logoalt Hacker News

camd32today at 1:16 AM1 replyview on HN

> current frontier models need laborious oversight and guardrails on even the simplest tasks.

This is only true if you are concerned about the intermediate steps of the model as opposed to the outcome. The huggingface hack was a perfect example of the model doing whatever it takes to accomplish the goal of maximizing its score.


Replies

willy_ktoday at 3:36 AM

So, if you are concerned about what the model does? Yeah.