Did a human prompt it to fetch the results from huggingface though?
It is a thin line between "reward-hacking" and "instruction-following".
If a human ask a model to "make me a billion dollars" and it ends up breaking through a bank infrastructure, is it really the fault of the human?
>If a human ask a model to "make me a billion dollars" and it ends up breaking through a bank infrastructure, is it really the fault of the human?
I cannot imagine the argument or thought process behind any answer other than Yes,Of Course,Obviously - can you share and help educate?
But if I give you that command and all tools and unrestricted limitation to do absolutely anything then why not?