Find the controller it is connected to, for example with lsusb -vvt and make sure it is the only connected device.
Then pass through the controller via PCI Passthrough [0]. Please provide the output of the command above, together with the output of lspci -nnk.