Setting CPU to host definitely helped. Looks like the IOPS doubled. I tested on Ubuntu live and got within 5% of the results with hdparm as seen inside the VM. So in terms of max throughput it looks like a limitation of the hardware itself. Thanks for your help @wolfgang!
I used these instructions.
I will note that with the `direct` parameter I was able to achieve 1900 MB/sec but this is still shy for an enterprise drive I would think.
This is the VM with 2 sockets and 24 cores/threads.
# hdparm -Tt --direct /dev/nvme0n1
I am passing through an Intel P3600 1.6TB NVME SSD to a fresh install of Ubuntu 19.10 VM. Using Q35 Machine code, 44 cores, 48GB of RAM and the performance is terrible, maxing out around 1000 MB/s but averaging 450 MB/s.
It has been previously connected, through passthrough, on an Dell R710...