Am I supposed to be embarrassed for defending someone against a baseless smear?

Anyway, call it "defensive" all you want. It doesn't change the historical thread: You argued, at best, his views made the workplace unwelcoming; the data shows he hires women at parity. You're just backpedaling because the reality didn't match your narrative vibes.