The human body has the ability to automate some muscular movements so the brain is out of the loop. Maybe these LLMs should be allowed to write in a small DSL that can trigger events out-of-band (something like "Oh fuck there's a spider, I'll set up a click spam loop and check in every 500ms").
I think they're doing exactly what you propose? Unless I'm misunderstanding what the Python "fishing scripts" with the timings and timeouts are doing.
https://labs.ycombinator.com/projects/games/index.html#fishi...