... provided you own land that the government allows for agricultural use. And most people can't afford to own enough land to be self-sufficient.

So you're not free to grow your own vegetables either; just like fishing, farming is regulated to manage limited resources. Things get ugly fast when you start raising pigs in your city apartment, or start polluting with pesticide runoff, or start diverting your neighbour's water supply...