Engaging in a relationship of any sort with a direct report (the second woman he reportedly had an affair with) is typically prohibited behavior. The imbalance of power between a boss and a subordinate in their report line just screams sexual harassment lawsuit waiting to happen.

It's nothing to do with prudishness about his sex life and everything to do with his actions endangering the company.