Thanks for the reply!
Yes, the machine has 72x cores, but I did try 8x just to test NUMA issues and it's exactly the same.
It's a RAID0 ZFS with 2x fast SSDs
They are set to 9000. I tried 1500 with the same result.
Makes my VMs crash (rarely), so I stopped using host.