alt Hacker NewsI agree wholeheartedly about your second sentence, but
“we made this artifact and don’t know why the thing it does looks spookily like cognition”
and
“this artifact makes decisions at random”
are obviously distinct categories and pretending otherwise is silly.
We know why it looks like cognition. Because OpenAI and Antropic put a lot of effort and training to humanize the output and make it sound like a person.
Regardless of negative consequences it brings. They have that project of creating tech god which will save the unborn people thousands years in the future ... so people living now dont matter.
That is why.