alt Hacker NewsI mean the direction of the AIs general tasking, it will do the command correctly but what it's trying to achieve isn't going in the right direction for whatever reason. You might be tempted to suggest a fix, but I truly mean for "whatever reason". There's dozens of different ways the AI gets onto a bad path, I would rather catch it early rather than come back to a failed run and have to start again.
I suppose the real question here is “how often should I check on the AI and course correct”.
My experience is if you have to manually approve every tool invocation the we’re talking every 3 to 15 seconds. This is infuriating and makes me want to flip tables. The worst possible cadence.
Every 5 or 15 minutes is more tolerable. Not too long for it to have gone crazy and wasted time. Short enough that I feel like I have a reasonable iteration cadence. But not too short that I can’t multi-task.