I think the "work" he talks about was unpaid and enforced. Stuff armed people forced you to do, that took up time you needed for your subsistence farming.