Affairs could be a whole lot more than that. For example, assuming he didn’t want his wife finding out he’s an ideal blackmail target for anyone that does know.