Both AMD and Intel have open source graphics drivers which are upstreamed into the Linux kernel, so that situation would be impossible with an AMD or Intel graphics card. Any driver issues are a pain that nvidia decided to inflict on you.