Sure, a bug.

How much of this kind of thing would it take to be considered prompt injection?

> If you can't delete your account, don't recommend a regulator

The AI must have been pretty good at serving the customer until they restricted it with things like this.