This has been done as a mod for the Valve Index, it works pretty well. Really is mainly a balance issue.