Apparently in the latest Nvidia drivers they have added "Beta" support of pci passthrough of graphics cards. So no more masking the VM, just directly passthrough the GPU. Of course you still have to make sure the host system is not using the card. Take a look at GeForce PCIe Passthrough Enabled! But what took so long???