it's also possible the wife knew and was okay with it

my wife and I date other people, you'd be surprised how big the ENM/Poly community is when you start looking