You’ve misread the room. Absolutely no one cares about the infidelity. One of the affairs has been public knowledge for months.
The outrage is about new reporting that one affair was with a potential Chinese asset, and the other affairs are more entertainment and/or evidence of bad leadership than anything else.
Americans will also balk at sexual relations with a professional underling where it’s difficult to establish whether truly unconditional consent was given.
many people seem to care about the infidelity