Proxmox cores with high memory

[harethtvalomer]

Hello I have Proxmox installed on

64 x AMD EPYC 7551 32-Core Processor (1 Socket)
Kernel Version Linux 5.13.19-6-pve
32GB RAM
Debian 11 latest version

Committing a 1TB Ram server with 4 cores boot up fine and works very fast, but if I put it 16, 32, 64 cores it hangs at booting and shutdown/disconnect every 5 minutes

 

[adamb]

Hello I have Proxmox installed on

64 x AMD EPYC 7551 32-Core Processor (1 Socket)
Kernel Version Linux 5.13.19-6-pve
32GB RAM
Debian 11 latest version

Committing a 1TB Ram server with 4 cores boot up fine and works very fast, but if I put it 16, 32, 64 cores it hangs at booting and shutdown/disconnect every 5 minutes

We run single VM's with 140+ cores and 3TB of ram without any issues.

What is the guest OS?

 

[harethtvalomer]

It's Windows Server 2022, same issue with 2019

 

[harethtvalomer]

We run single VM's with 140+ cores and 3TB of ram without any issues.

What is the guest OS?

Do I have to enable any CPU Flags or any tweaks on the VM, Can I see your VM Config

 

[adamb]

Do I have to enable any CPU Flags or any tweaks on the VM, Can I see your VM Config

I don't think so.

bootdisk: virtio0
cores: 36
cpu: host,flags=+pdpe1gb
memory: 2940311
name: ####
net0: virtio=CE:76:8C:74:61:0A,bridge=vmbr0,firewall=1
net1: virtio=9E:F2:F5:60:CE:15,bridge=vmbr1,firewall=1
numa: 1
onboot: 1
ostype: l26
scsihw: virtio-scsi-pci
smbios1: uuid=2123a8a4-9cde-464f-99bf-c7c8a6345e1a
sockets: 4
virtio0: os:vm-100-disk-0,size=300G
virtio1: data:vm-100-disk-0,backup=0,size=15180G
vmgenid: 9e65775e-b3e0-4ca3-87ff-0cde8d07208e

 

[harethtvalomer]

agent: 1
bios: ovmf
boot: order=sata0;net0
cores: 64
cpu: host,flags=+pdpe1gb
cpuunits: 8196
efidisk0: local:107/vm-107-disk-0.qcow2,efitype=4m,pre-enrolled-keys=1,size=528K
machine: pc-q35-6.1
memory: 1048576
meta: creation-qemu=6.1.1,ctime=1648392868
name: #######
net0: virtio=02:3F:87:F6:95:0D,bridge=vmbr0,firewall=1
numa: 1
ostype: win11
sata0: local:107/vm-107-disk-1.qcow2,cache=writeback,discard=on,size=600G,ssd=1
scsihw: virtio-scsi-pci
smbios1: uuid=6ec0ff27-57e7-420c-b983-215470538a0c
sockets: 1
tpmstate0: local:107/vm-107-disk-2.qcow2,size=4M,version=v2.0
vcpus: 64
vmgenid: f415a9a5-c107-42a0-bbca-83c7439ea208

 

[harethtvalomer]

What am I doing wrong

 

[adamb]

What am I doing wrong

What is the guest OS. Could be AMD related as well.

 

[harethtvalomer]

What is the guest OS. Could be AMD related as well.

win11

 

[adamb]

win11

Maybe try a different CPU model (host, kvm, etc). Or see if a linux VM boots up.

 

[adamb]

Maybe try a different CPU model (host, kvm, etc). Or see if a linux VM boots up.

You could also for giggles try using socket 2 with 8 cores, or socket 4 with 4 cores.

 

[harethtvalomer]

You could also for giggles try using socket 2 with 8 cores, or socket 4 with 4 cores.

Did not work