Many qualities of people who accomplish extraordinary things do not correlate with strong interpersonal relationships. The comment was a little overly judgmental so I totally understand your comments, but put politely, it isn't particularly unreasonable.
Absentee parenting is a novel concept; in ages prior it was the norm. That said, I'm on board with being there for the kids, all the evidence is positive. Unless you're English, in which case: chin up, keep calm and carry on! That's another contributing factor: the guy possibly went to boarding school.