I don't think that's true. There are some subsistence societies, blessed with abundant resources and neighbors with no interest in taking them, where people worked less. In many societies people worked more. (And of course, in all premodern societies, it was common to have famines where many of your neighbors would starve to death because they couldn't get enough food no matter how much they worked.)