Germany is not EU though. Very different bureaucracy in different EU countries. Up to a point, EU doesn't add a single bit of bureaucracy to the stack. Only once you reach a certain limit you will have to enroll in an international VAT system, which is not too bad.
EDIT: Just re-read your message. I thought it said EU. But the point stands, Germany is not Europe either.
In many other european countries, the story doesn't change much - with some exceptions. The irony is that the EU is now discussing EU Inc. a law to let startups incorporate online within 48 hours, for at most €100, under a single optional corporate framework across Europe.
That is exactly the right direction. But for now it is just a proposal