They definitely write off by one errors. One of the first serious work tasks I used AI for a few months ago immediately had an off by one error.
What they are really good at is writing boilerplate and reading API documentation / example code. Avoiding subtle errors is not what they're good at in my experience.