I concur, a majority are not productive most of the time. However a majority is far from everyone.
Leaving aside for the moment people working multiple jobs for whom free time is a luxury.
Leaving aside working parents who are also raising children who choose to spend that time with them.
Of the rest, though we do see some productive outlets. Open Source Software for example being perhaps the poster child for work done without return.
Or what about those who volunteer? Perhaps in a church context or charity context or whatever.
Or all those with a side hustle, selling home-made goods in weekend markets. Some of that to earn more, some to exercise their creativity.
Yes, in countries where there are sufficient social nets that unemployed people can survive some choose not to work. And yet the overall unemployment numbers in those countries is pretty low.
So maybe "majority" isn't really the right term?