Based on the research mathematicians I have known, I'd disagree with 'they'd probably be doing something else if they had absolute freedom over their time' for at least a large number of them, although it probably varies from individual to individual.