I think that if he'd 1) fessed up to all affairs as soon as the Alice Huang story dropped and 2) not slept with employees he'd still be there.
Managers having relations with reports and other employees is an HR nightmare and can't be tolerated. Doesn't matter even if it was consensual and between two people whose spouses were okay with it. It taints every decision the manager makes with respect to that person.
Not helped by the fact that it wasn't just a single employee, but (at least) two. It stops being "a mistake" and starts being "a series".
Practically that’s true, in that everyone knew they were evading sanctions through Singapore, but this was a concerted hit job against Huang so I think that still happens.
Marco Rubio, in particular, and the frontier labs wanted Huang gone. They would keep pushing even if the only evidence was, “multiple external affairs.”
Note that the CIA won’t stand behind Alice Huang being a foreign agent, and they love a good takedown