>why would people all over the world adopt it against their own self interest

There was no easy going back. Once agricultural societies had settled there would be little if any free land to hunt/gather on. Also, much of the traditional knowledge would be lost in a few generations. Plus, peasants were often kept on their land by force.