For most folks it's just an add on. I have grandparents in Europe that have a garden where they grew potatoes and about 50 other things I'm not gonna list. They make jams, pickled things, and various other preserves. It's something to do and kept them sharp until they hit their late 80s.
Agreed. There's a world of difference between 'farming' for personal to small scale production as not quite a recreation but also not quite a job, and farming a low margin staple at high volume as your primary and sole means of earning money.
And I think when most people speak of the dream of returning to rural society to e.g. farm, they're speaking very much of the former rather than the latter.