I tried this for a virtualized full screen gnome desktop environment but the latency was unbearable. I also couldn't get passthrough of command/caps lock etc to the virtual machine stable. Finally connecting an USB device (like a yubikey) didn't work seamless.