Test / LUKS / SoftRaid-10-F2 / Slow VM Performance

fstrankowski

fstrankowski

Well-Known Member
Nov 28, 2016
72
13
48
39
Hamburg
Hey guys,

Despite beeing an enterprise customer with dozens of machines, i've tried to replicate a setup we run from time to time:

Enterprise Hardware
  • Xeon 1650v2
  • 4x 2 TB SATA
  • Softraid 10-F2
  • LUKS Full-Encryption
Using standalone setups our VMs achive same performance as our hosts using LVM+VirtIO+Nocache with the LVM beeing fully encrypted as said above.

Using Proxmox ontop makes the VM (both times 2 or 8 cores doesnt matter) go nuts and host IO-Wait goes 100%.

Without Proxmox :
  • 240 Mb/s write on host
  • 240 Mb/s write on guest (KVM both VirtIO and SCSI) + IO-Wait 10-50% on 3-4 cores (hostside)
With Proxmox
  • 240 Mb/s write on host
  • 80 Mb/s write on guest (KVM,NoCache,VirtIO or SCSI) + IO-Wait 100% on all 8 cores (hostside)

Any ideas? Does Proxmox implement some additional LVM-layer there? I simply cant figure out where the massive performance-drops result from. Its the same hardware, to the point. Just one time with Debian KVM and one time with Proxmox toolchain on top (and Proxmox KVM tools).

PVE 4.2


Differences that i've spotted so far:

  • Our LVs use a read-ahead of 8192, Proxmox goes for 6144 (probably because of "generic" setting in /etc/lvm/lvm.conf)
 
Last edited:
Out of curiosity i took the LV of my Proxmox VM, formatted it with ext4 and mounted it on the host. Tested the speed and had perfect fine performance, like without Proxmox. So its definitly not the filesystem itself which makes CPU go to 100%. Again, there has to be something wrong on Proxmox side.
 
Another test revealed, that LXC are fine and i'm getting near-host-speed aswell. So the problem exists only when using KVM. All tests were made on the exact same PV/LV-Pool
 
Searching the forums for 1 day now led me to this thread: https://forum.proxmox.com/threads/performance-issue-with-proxmox-4-high-io-delay.26012 where people suggesting barrior problems with ext4. This makes no sense as LXC works fine and mounting the volume on the host-node works fine either.

Further does the massive IO-Wait only happen when using Proxmox with own KVM-Chain instead of Debian-KVM-Chain.

Im out of ideas and so i think i will move off from Proxmox for now. This is absolutely insane that using default Debian KVM/LVM works fine and Proxmox does not.
 
Okay i couldnt let this go so i kept digging and here is what i've found. I was curious why for gods sake my hypervisor with Proxmox made 100% CPU-load on all 8 cores when a VM is write-intensive while without Proxmox and going for libvirt+kvm is totally fine.

IOtop gave the difference:

Someone please tell me why Proxmox opens like 10000 threads if the guest does a dd with a 1 gig file??? (Tested with Proxmox 4.4 stable and 5.0 beta)

This is Libvirt+KVM:
Code: 
Total DISK READ :       0.00 B/s | Total DISK WRITE :     234.17 M/s
Actual DISK READ:       0.00 B/s | Actual DISK WRITE:     234.17 M/s
  TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN     IO>    COMMAND
 1186 be/4 libvirt-    0.00 B/s  234.17 M/s  0.00 %  0.00 % qemu-system-x86_64 -enable-kvm -name web11 -S -machine pc-i440fx-2.1,accel=kvm,usb=off -cpu SandyBridge,+invtsc,+erms,+smep,+fsgsbase,+pdpe1gb,+rdrand,+f16c,+osxsave,+dca,+pcid,+pdcm,+xtpr,+tm~,addr=0x6 -chardev pty,id=charserial0 -device isa-serial,chardev=charserial0,id=serial0 -device usb-tablet,id=input0 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5 -msg timestamp=on
 1024 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % rsyslogd -n [in:imklog]
    1 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % init
    2 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kthreadd]
    3 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [ksoftirqd/0]
 1028 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % libvirtd
    5 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kworker/0:0H]

This is Proxmox:
Code: 
Total DISK READ :       0.00 B/s | Total DISK WRITE :       0.00 B/s
Actual DISK READ:       0.00 B/s | Actual DISK WRITE:     166.25 M/s
  TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN     IO>    COMMAND
 2441 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2443 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2450 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2475 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2465 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2422 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2429 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2427 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2481 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2421 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2452 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2458 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2428 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2472 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2438 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2478 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2446 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2442 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2451 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2449 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2423 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2471 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2430 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2468 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2469 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2445 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2479 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2476 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2434 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2426 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2437 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2435 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2464 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2456 be/4 root        0.00 B/s    0.00 B/s  0.00 % 96.55 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2424 be/4 root        0.00 B/s    0.00 B/s  0.00 % 94.97 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2483 be/4 root        0.00 B/s    0.00 B/s  0.00 % 93.46 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2474 be/4 root        0.00 B/s    0.00 B/s  0.00 % 91.36 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2463 be/4 root        0.00 B/s    0.00 B/s  0.00 % 86.73 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2453 be/4 root        0.00 B/s    0.00 B/s  0.00 % 85.62 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2470 be/4 root        0.00 B/s    0.00 B/s  0.00 % 85.20 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2431 be/4 root        0.00 B/s    0.00 B/s  0.00 % 83.42 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2473 be/4 root        0.00 B/s    0.00 B/s  0.00 % 83.39 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2448 be/4 root        0.00 B/s    0.00 B/s  0.00 % 83.29 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2467 be/4 root        0.00 B/s    0.00 B/s  0.00 % 81.04 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2459 be/4 root        0.00 B/s    0.00 B/s  0.00 % 80.73 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2455 be/4 root        0.00 B/s    0.00 B/s  0.00 % 77.57 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2477 be/4 root        0.00 B/s    0.00 B/s  0.00 % 59.44 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2461 be/4 root        0.00 B/s    0.00 B/s  0.00 % 59.41 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2412 be/4 root        0.00 B/s    0.00 B/s  0.00 % 59.26 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2444 be/4 root        0.00 B/s    0.00 B/s  0.00 % 59.21 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2440 be/4 root        0.00 B/s    0.00 B/s  0.00 % 59.21 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2447 be/4 root        0.00 B/s    0.00 B/s  0.00 % 57.73 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2425 be/4 root        0.00 B/s    0.00 B/s  0.00 % 57.54 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2460 be/4 root        0.00 B/s    0.00 B/s  0.00 % 57.21 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:59,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300
 2432 be/4 root        0.00 B/s    0.00 B/s  0.00 % 56.84 % kvm -id 100 -chardev socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait -mon chardev=qmp,mode=control -pidfile /var/run/qemu-server/100.pid -daemonize -smbios type=1,uuid=d8a7bbf4-2~cript=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on -device virtio-net-pci,mac=02:00:00:4b:d6:
 
Sure:

Code: 
bootdisk: scsi0
cores: 2
cpu: host
ide2: none,media=cdrom
memory: 8192
name: test
net0: virtio=02:00:00:4b:d6:59,bridge=vmbr0
numa: 0
ostype: l26
scsi0: vm:vm-100-disk-1,size=32G,scsiblock=1
scsihw: virtio-scsi-pci
smbios1: uuid=496b88cf-74f9-4078-87e3-b99247c609e1
sockets: 1

  • same with virtio0
  • same without scsiblock
  • same with iothread
  • same without iothread
As said before, this applies only to KVM, LXC works fine.
 
I'll do test, but it's really strange. qemu use only 1thread for data access. (or 1 thread for each iothread disk), you shouldn't have more threads in total than (cores*socket).

do you see same behaviour with other storage ? (plain .raw file for example ?)
 
  • Like
Reactions: fstrankowski
This bug is most probably kvm-related due to patches from Proxmox team. I'm currently analysing the changes they've made to the original upstream.

Regarding your question: Results:
  • .raw-images seem to work
  • lvm-thin is affected by this bug
  • lvm-thick is affected by this bug
 
Last edited:
I've done more research. Setup 5 more boxes to test with. Same results. Either with default Proxmox ISO and also via manual installation. Same result. Using VMs makes KVM/QEMU create _way_ too much IO-Threads. Can any Proxmox-Staff please join the discussion here?

Update:

IDE-Driver does _NOT_ show such a behavior. All other adapters do. IDE is pretty slow though :<
 
Last edited:
I think i've done more than enough to get this bug reported. I expect the devs to look at this forum as i dislike mailing lists.
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back