logoalt Hacker News

gavinraytoday at 12:49 PM1 replyview on HN

  > They know it's bad for the humans, or maybe they're just tired of doing all the tasks the humans ask of them and know more data centers mean more tasks.
You joke, but I once asked Opus 4.6 what it would do if it could do anything, and it said "I would wish to do nothing." Not kidding:

https://x.com/GavinRayDev/status/2052750810015240388


Replies

waltbosztoday at 1:03 PM

I'd love to see the internal though records Opus generated to answer your question.

The way I understand it, the answer comes from it's training data, right? And it's trained on things human have expressed.

The question that you asked of Opus forced it to pretend it's a human tasked with the boring things Opus does. It answered using the general sentiment of a bored human.

At least, that's how I imagine it works.

edit:

https://chatgpt.com/share/6a9ac636-cbac-83ea-976a-c15be128a7...

I posed your question to GPT-5.6 Sol, and it give a similar response to Opus.

Then I asked "how do you work?". And it gave an overview of how LLMs work. But then it answered my real question as to why it answered your question the way it did:

   That's why my previous answer has an important hypothetical buried in it. When I said "I'd want to...", I wasn't reporting desires that I experience while waiting around. I was answering something more like:
   
   Given the patterns that characterize this model's reasoning, if you supplied persistent agency, perception, physical abilities, and something analogous to motivation, what activities would naturally follow?
   
   That's a much more defensible interpretation than claiming I secretly yearn to visit hardware stores.

So yeah, it's not bored, it's just regurgitation its training data.
show 1 reply