I routinely see AI taking the easy way out. Writing mountains of code to make tests turn green based in odd and unintuitive side effects.

That's not to say it isn't useful, and if youre on top of it you can guide it away from doing that.