Recent content by gkuyuk

  1. G

    NVME Passthrough performance

    That did not make much difference but "pci=pcie_bus_perf" this. For future reference to others: 1- CPU Type: Host and NUMA enabled 2- Check the nvme afinity and put it in CPU Affinity under CPU settings (---for d in /sys/bus/pci/devices/*/nvme; do echo "$(dirname $d): NUMA $(cat $(dirname...
  2. G

    NVME Passthrough performance

    It is on q35 otherwise it dos not let me do pcie option on the passthrough. this last change did it. Read Test: Jobs: 32 (f=32): [R(32)][2.5%][r=9684MiB/s][r=2479k IOPS][eta 01m:57s] Jobs: 32 (f=32): [R(32)][4.2%][r=9630MiB/s][r=2465k IOPS][eta 01m:55s] Jobbs: 32 (f=32)...
  3. G

    NVME Passthrough performance

    Here is the ouput for the affinity: root@test1:~# for d in /sys/bus/pci/devices/*/nvme; do echo "$(dirname $d): NUMA $(cat $(dirname $d)/numa_node)"; done /sys/bus/pci/devices/0000:c1:00.0: NUMA 0 /sys/bus/pci/devices/0000:c3:00.0: NUMA 0 I am running the fio test always with more than 4...
  4. G

    NVME Passthrough performance

    DId you ever solve this problem? I am in the same boat, I have a PM1753 NVME disk with 600K write and 3.3M read IOPS, if I test it within proxmox itself with fio I get those IOPS, either as a rad device or mounted as XFS but if I do a passthrough to the VM performance goes down to around 180K...
  5. G

    Mellanox ConnectX-3 Speed Issues on Dell R630 (tested on R620, R630,R730)

    I am trying to setup a Mellanox ConnectX-3 infiniband with IBoP and hitting a speed issue. Same adapter works fine on supermicro servers without any issues. With 2 supermicro servers using iperf3 with multiple threads it goes over 30mbps in both directions without any issues. When using the Dell...
  6. G

    PBS Install Fails with CTRL+ALT+F2 message due to xserver connection error

    Hi All, In case this helps some people our there. I was intalling PBS on a server and it failed after getting the IP address and comes up with the error message for CTRL+ALT+F2 to see the error on another terminal and there you can see it fails to connect the xserver. Here is the fix, on the...