The "convoluted" way is/was the default in the absence of a monopolist app store. Before centralised app stores, users downloaded or bought boxed software ad-hoc and installed it on their computers from installation archives, just like you can install apps from APK files on Android. If you banned Google from preloading their app store, isn't that what we would revert to?
On my Nokia (featurephone) you don't need to install apps, you just run them.