Do we really want to let society crumble? I do not argue that Western society is deeply sick, but an abrupt collapse of the current order will leave us in an intermediary period of poverty and war (see the French and Russian revolutions). Even the American revolution notably kept in place a lot of the pre-existing English culture and legal customs that the colonies were already following before England started interfering.
Also, rebuilding from scratch is a fantasy because we have exhausted many of the mineral resources that a less advanced society could extract.