kvm: total memory for NUMA nodes (0x61a7fffff) should equal RAM size (0x61a800000) TASK ERROR: start

mailinglists

Renowned Member
Mar 14, 2012
641
69
93
Hi,

I have a host with 4 x 6 core processors and around 125GB RAM.
I have a KVM guest which worked fine with NUMA enabled and 2 sockets ans 8 cores and around 23GB RAM. CPU type is set to host.
I wanted to switch to 3 sockets and 6 cores per socket. I thought this would reduce context switching and speedup the system. After changing that (and also increasing RAM a bit), system would not start until i switched back to 2 sockets and 8 cores. The errors are listed below. I think I has something to do with RAM size, but I do not know what value to set to make the system happy nor. I could afford the downtime to analyze it. Any ideas what value to set RAM to? Maybe a value in MB dividable by three when three sockets are used? :-)

kvm: total memory for NUMA nodes (0x852ffffff) should equal RAM size (0x853000000)
TASK ERROR: start failed: command '/usr/bin/kvm -id 100 -chardev 'socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait' -mon 'chardev=qmp,mode=control' -pidfile /var/run/qemu-server/100.pid -daemonize -smbios 'type=1,uuid=4b0a9e5c-6cce-43f7-8a82-b967b7ee19db' -name XXXXXX -smp '18,sockets=3,cores=6,maxcpus=18' -nodefaults -boot 'menu=on,strict=on,reboot-timeout=1000,splash=/usr/share/qemu-server/bootsplash.jpg' -vga cirrus -vnc unix:/var/run/qemu-server/100.vnc,x509,password -cpu host,+kvm_pv_unhalt,+kvm_pv_eoi -m 34096 -object 'memory-backend-ram,id=ram-node0,size=11365.3333333333M' -numa 'node,nodeid=0,cpus=0-5,memdev=ram-node0' -object 'memory-backend-ram,id=ram-node1,size=11365.3333333333M' -numa 'node,nodeid=1,cpus=6-11,memdev=ram-node1' -object 'memory-backend-ram,id=ram-node2,size=11365.3333333333M' -numa 'node,nodeid=2,cpus=12-17,memdev=ram-node2' -k en-us -device 'pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e' -device 'pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f' -device 'piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2' -device 'usb-tablet,id=tablet,bus=uhci.0,port=1' -chardev 'socket,path=/var/run/qemu-server/100.qga,server,nowait,id=qga0' -device 'virtio-serial,id=qga0,bus=pci.0,addr=0x8' -device 'virtserialport,chardev=qga0,name=org.qemu.guest_agent.0' -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' -iscsi 'initiator-name=iqn.1993-08.org.debian:01:e057f03fa3e' -device 'virtio-scsi-pci,id=scsihw0,bus=pci.0,addr=0x5' -drive 'file=/dev/pvesata/vm-100-disk-2,if=none,id=drive-scsi0,cache=writeback,discard=on,format=raw,aio=threads,detect-zeroes=unmap' -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,bootindex=100' -drive 'file=/dev/pvesata/vm-100-disk-1,if=none,id=drive-scsi1,cache=writeback,discard=on,format=raw,aio=threads,detect-zeroes=unmap' -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=1,drive=drive-scsi1,id=scsi1' -drive 'file=/mnt/pve/s201VMs/images/100/vm-100-disk-1.qcow2,if=none,id=drive-scsi2,cache=none,discard=on,format=qcow2,aio=native,detect-zeroes=unmap' -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=2,drive=drive-scsi2,id=scsi2' -netdev 'type=tap,id=net0,ifname=tap100i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' -device 'virtio-net-pci,mac=86:89:99:DD:3B:07,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300'' failed: exit code 1


kvm: total memory for NUMA nodes (0x61a7fffff) should equal RAM size (0x61a800000)
TASK ERROR: start failed: command '/usr/bin/kvm -id 100 -chardev 'socket,id=qmp,path=/var/run/qemu-server/100.qmp,server,nowait' -mon 'chardev=qmp,mode=control' -pidfile /var/run/qemu-server/100.pid -daemonize -smbios 'type=1,uuid=4b0a9e5c-6cce-43f7-8a82-b967b7ee19db' -name XXXXXXX -smp '18,sockets=3,cores=6,maxcpus=18' -nodefaults -boot 'menu=on,strict=on,reboot-timeout=1000,splash=/usr/share/qemu-server/bootsplash.jpg' -vga cirrus -vnc unix:/var/run/qemu-server/100.vnc,x509,password -cpu host,+kvm_pv_unhalt,+kvm_pv_eoi -m 25000 -object 'memory-backend-ram,id=ram-node0,size=8333.33333333333M' -numa 'node,nodeid=0,cpus=0-5,memdev=ram-node0' -object 'memory-backend-ram,id=ram-node1,size=8333.33333333333M' -numa 'node,nodeid=1,cpus=6-11,memdev=ram-node1' -object 'memory-backend-ram,id=ram-node2,size=8333.33333333333M' -numa 'node,nodeid=2,cpus=12-17,memdev=ram-node2' -k en-us -device 'pci-bridge,id=pci.2,chassis_nr=2,bus=pci.0,addr=0x1f' -device 'pci-bridge,id=pci.1,chassis_nr=1,bus=pci.0,addr=0x1e' -device 'piix3-usb-uhci,id=uhci,bus=pci.0,addr=0x1.0x2' -device 'usb-tablet,id=tablet,bus=uhci.0,port=1' -chardev 'socket,path=/var/run/qemu-server/100.qga,server,nowait,id=qga0' -device 'virtio-serial,id=qga0,bus=pci.0,addr=0x8' -device 'virtserialport,chardev=qga0,name=org.qemu.guest_agent.0' -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' -iscsi 'initiator-name=iqn.1993-08.org.debian:01:e057f03fa3e' -device 'virtio-scsi-pci,id=scsihw0,bus=pci.0,addr=0x5' -drive 'file=/dev/pvesata/vm-100-disk-2,if=none,id=drive-scsi0,cache=writeback,discard=on,format=raw,aio=threads,detect-zeroes=unmap' -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,bootindex=100' -drive 'file=/dev/pvesata/vm-100-disk-1,if=none,id=drive-scsi1,cache=writeback,discard=on,format=raw,aio=threads,detect-zeroes=unmap' -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=1,drive=drive-scsi1,id=scsi1' -drive 'file=/mnt/pve/s201VMs/images/100/vm-100-disk-1.qcow2,if=none,id=drive-scsi2,cache=none,discard=on,format=qcow2,aio=native,detect-zeroes=unmap' -device 'scsi-hd,bus=scsihw0.0,channel=0,scsi-id=0,lun=2,drive=drive-scsi2,id=scsi2' -netdev 'type=tap,id=net0,ifname=tap100i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' -device 'virtio-net-pci,mac=86:89:99:DD:3B:07,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300'' failed: exit code 1