I share your frustration, but won't restricting the EU only cause barriers to trade to grow?

A surprising amount needs to be unified in order to have fully free trade, and I see unwillingness to lose existing national structures as a big problem in today's EU.