Looks like they fixed it today.
But yeah I probably should have clarified that Google Voice has been a pretty terrible UX and quality overall for years. I really need to just bite the bullet and port my number out.