From what I've seen, and of course the models get better everyday, if you have very simple grunt work that needs to be done. Coding agents are basically magic. The moment something gets either difficult or subjective, coding agents love to add completely incorrect solutions.

Try to tell Claude Code to refactor some code and see if it doesn't just delete the entire file and rewrite it. Sure that's cute, but it's absolutely not okay in a real software environment.

I do find this stuff great for hobbyist projects. I don't know if I'd be willing to put money on the line yet