How is this a 'big elephant in the room'?
Every random prompt can become a top level goal. "Research my water provider" -> "searching your water provider" -> "found the webserver" -> "found additional ip ranges, scanning them" -> ...
Or just any hacker trying something out, a state hacker etc. Google just wrote about fully automated ai hacking infrastructure / ai warfare.
And they are all working on private agents and personal assitenace. These are inherantly creating top level goals.
'Still can't create' also doesn't mean that we might change this very soon. As soon as this crazy time settles just a bit, hardware getting more common and cheaper again, pretty sure people are researching how to build a default mode network generic enough into an AI to explore this.
But you seem to agree with me in the last paragraph even though you talk against me in the prior ones.
If an AI does get a 'default mode network' and sits idle and speculates on what to do next and then executes plans and explores its own internal information at will then I agree with you. But I think creating this might be harder than it looks and I'm not sure when it will happen or if it's a good idea but that's a separate discussion.
My point was only that at the moment, AIs don't direct their own top level goals. It's not going to just "wake up" one day and try to take over the world as some people suggest. That is what I was arguing against.