v5.0 beta 1 LXC Problem - "cpu id '16' is out of range"

David Hooton

Active Member
Apr 12, 2017
13
3
43
46
Hi Guys,

I've just run an upgrade from 4.4 to 5.0-6/669657df using the apt dist-upgrade method.

Everything seems to have run properly however LXC containers won't come up, I am getting a "cpu id '16' is out of range" error in the front end and am seeing the following in /var/log/pve/tasks/active for every LXC container I try to start:

Code:
UPID:bruce:00001E25:0001D077:58ED81E3:vzstart:100:root@pam: 1 58ED81E3 cpu id '16' is out of range
UPID:bruce:000017BC:0000ED3A:58ED7F9D:vzstart:100:root@pam: 1 58ED7F9D cpu id '16' is out of range
UPID:bruce:00001658:00009BC9:58ED7ECD:vzstart:100:root@pam: 1 58ED7ECD cpu id '16' is out of range

Code:
root@bruce:~# pveversion -v
proxmox-ve: 5.0-5 (running kernel: 4.10.5-1-pve)
pve-manager: 5.0-6 (running version: 5.0-6/669657df)
pve-kernel-4.4.40-1-pve: 4.4.40-82
pve-kernel-4.4.35-2-pve: 4.4.35-79
pve-kernel-4.10.5-1-pve: 4.10.5-5
pve-kernel-4.4.19-1-pve: 4.4.19-66
pve-kernel-4.4.49-1-pve: 4.4.49-86
pve-kernel-4.4.35-1-pve: 4.4.35-77
pve-kernel-4.4.21-1-pve: 4.4.21-71
pve-kernel-4.4.44-1-pve: 4.4.44-84
libpve-http-server-perl: 2.0-1
lvm2: 2.02.168-pve1
corosync: 2.4.2-pve2
libqb0: 1.0.1-1
pve-cluster: 5.0-4
qemu-server: 5.0-2
pve-firmware: 2.0-2
libpve-common-perl: 5.0-7
libpve-guest-common-perl: 2.0-1
libpve-access-control: 5.0-3
libpve-storage-perl: 5.0-3
pve-libspice-server1: 0.12.8-3
vncterm: 1.4-1
pve-docs: 5.0-1
pve-qemu-kvm: 2.9.0-1~rc3
pve-container: 2.0-6
pve-firewall: 3.0-1
pve-ha-manager: 2.0-1
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.0.7-500
lxcfs: 2.0.6-pve500
criu: 2.11.1-1~bpo90
novnc-pve: 0.5-9
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.6.5.9-pve16~bpo90
openvswitch-switch: 2.7.0-2
root@bruce:~#

I am also getting the following errors in /var/log/syslog

Code:
Apr 12 12:58:36 bruce pvestatd[4676]: lxc cpuset rebalance error: cpu id '16' is out of range
Apr 12 12:58:46 bruce pvestatd[4676]: lxc cpuset rebalance error: cpu id '16' is out of range
Apr 12 12:58:56 bruce pvestatd[4676]: lxc cpuset rebalance error: cpu id '16' is out of range
Apr 12 12:59:06 bruce pvestatd[4676]: lxc cpuset rebalance error: cpu id '16' is out of range
Apr 12 12:59:17 bruce pvestatd[4676]: lxc cpuset rebalance error: cpu id '16' is out of range

CPU ID 16 seems to exist as well

Code:
root@bruce:/etc# cat /proc/cpuinfo | grep processor
processor : 0
processor : 1
processor : 4
processor : 6
processor : 8
processor : 10
processor : 12
processor : 14
processor : 16
processor : 18
processor : 20
processor : 22
processor : 24
processor : 26
processor : 28
processor : 30
root@bruce:/etc#

Code:
root@bruce:~# pct config 100
arch: amd64
cores: 8
cpuunits: 102400
description: plex01-s1-nsw%0A
hostname: plex01-s1-nsw
memory: 16384
mp0: local-lvm:vm-100-disk-1,mp=/data2,size=500G
net0: name=eth0,bridge=vmbr0,firewall=1,gw=xxx.xxx.xxx.241,gw6=xxxx:xxxx:fcff::1,hwaddr=B2:E6:49:3E:5F:C6,ip=xxx.xxx.xxx.243/28,ip6=xxxx:xxxx:fcff::3/64,tag=100,type=veth
onboot: 1
ostype: ubuntu
rootfs: data:subvol-100-disk-1,size=20T
swap: 16384
root@bruce:~#

Code:
root@bruce:~# pct cpusets
no running containers
root@bruce:~#

Code:
root@bruce:~# lscpu
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                16
On-line CPU(s) list:   0,1,4,6,8,10,12,14,16,18,20,22,24,26,28,30
Thread(s) per core:    2
Core(s) per socket:    4
Socket(s):             2
NUMA node(s):          2
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 26
Model name:            Intel(R) Xeon(R) CPU           E5520  @ 2.27GHz
Stepping:              5
CPU MHz:               2266.000
CPU max MHz:           2266.0000
CPU min MHz:           1600.0000
BogoMIPS:              4533.13
Virtualization:        VT-x
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              8192K
NUMA node0 CPU(s):     1,4,8,12,16,20,24,28
NUMA node1 CPU(s):     0,6,10,14,18,22,26,30
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm tpr_shadow vnmi flexpriority ept vpid dtherm ida
root@bruce:~#
 
Last edited:
Is this installation running inside some container or virtualized environment? You seem to have non continuous processor IDs. The question is whether this has been the case in 4.4 as well? How current were the 4.4 packages?
 
Hi,

The install is directly installed on an HP P4500 G2, there is no containerisation.

The 4.4 version was completely up to date and worked fine prior to the upgrade.

I have no idea about the CPU ID's prior to the upgrade but I suspect it may be related to the new version of Debian.
 
I've ran into the same issue on my HP P4500 G2. I'll be able to post output for 4.4 and 5 later today

EDIT:
Both 4.4 and 5 outputs are from clean installs with "apt-get update && apt-get upgrade" ran on them

Code:
root@centimanes:~# pveversion -v
proxmox-ve: 4.4-76 (running kernel: 4.4.35-1-pve)
pve-manager: 4.4-1 (running version: 4.4-1/eb2d6f1e)
pve-kernel-4.4.35-1-pve: 4.4.35-76
lvm2: 2.02.116-pve3
corosync-pve: 2.4.0-1
libqb0: 1.0-1
pve-cluster: 4.0-48
qemu-server: 4.0-101
pve-firmware: 1.1-10
libpve-common-perl: 4.0-83
libpve-access-control: 4.0-19
libpve-storage-perl: 4.0-70
pve-libspice-server1: 0.12.8-1
vncterm: 1.2-1
pve-docs: 4.4-1
pve-qemu-kvm: 2.7.0-9
pve-container: 1.0-88
pve-firewall: 2.0-33
pve-ha-manager: 1.0-38
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u3
lxc-pve: 2.0.6-2
lxcfs: 2.0.5-pve1
criu: 1.6.0-1
novnc-pve: 0.5-8
smartmontools: 6.5+svn4324-1~pve80
zfsutils: 0.6.5.8-pve13~bpo80

Code:
root@centimanes:~# cat /proc/cpuinfo | grep processor
processor       : 0
processor       : 1
processor       : 2
processor       : 3
processor       : 4
processor       : 5
processor       : 6
processor       : 7
processor       : 8
processor       : 9
processor       : 10
processor       : 11
processor       : 12
processor       : 13
processor       : 14
processor       : 15
processor       : 16
processor       : 17
processor       : 18
processor       : 19
processor       : 20
processor       : 21
processor       : 22
processor       : 23

Code:
root@centimanes:~# pct config 101
arch: amd64
cores: 2
hostname: *REDACTED*
memory: 3072
nameserver: 10.0.0.1
net0: name=eth0,bridge=vmbr1,gw=10.0.0.1,hwaddr=02:C0:23:E4:CD:B5,ip=10.0.0.3/24,type=veth
ostype: debian
rootfs: local-zfs:subvol-101-disk-1,size=16G
searchdomain: *REDACTED*
swap: 512

Code:
root@centimanes:~# pct cpusets
-----------------------
101:  0               8
-----------------------

Code:
# From /var/log/pve/tasks/active
UPID:centimanes:00000FC7:00004C32:58EE5C7E:vzstart:101:root@pam: 1 58EE5C7E cpu id '27' is out of range
UPID:centimanes:00000FC6:00004BBE:58EE5C7D:vzstart:101:root@pam: 1 58EE5C7D cpu id '27' is out of range

Code:
root@centimanes:~# pveversion -v
proxmox-ve: 5.0-5 (running kernel: 4.10.5-1-pve)
pve-manager: 5.0-6 (running version: 5.0-6/669657df)
pve-kernel-4.10.1-2-pve: 4.10.1-2
pve-kernel-4.10.5-1-pve: 4.10.5-5
libpve-http-server-perl: 2.0-1
lvm2: 2.02.168-pve1
corosync: 2.4.2-pve2
libqb0: 1.0.1-1
pve-cluster: 5.0-4
qemu-server: 5.0-2
pve-firmware: 2.0-2
libpve-common-perl: 5.0-7
libpve-guest-common-perl: 2.0-1
libpve-access-control: 5.0-3
libpve-storage-perl: 5.0-3
pve-libspice-server1: 0.12.8-3
vncterm: 1.4-1
pve-docs: 5.0-1
pve-qemu-kvm: 2.9.0-1~rc3
pve-container: 2.0-6
pve-firewall: 3.0-1
pve-ha-manager: 2.0-1
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.0.7-500
lxcfs: 2.0.6-pve500
criu: 2.11.1-1~bpo90
novnc-pve: 0.5-9
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.6.5.9-pve16~bpo90

Code:
root@centimanes:~# cat /proc/cpuinfo | grep processor
processor       : 0
processor       : 1
processor       : 2
processor       : 3
processor       : 4
processor       : 5
processor       : 6
processor       : 7
processor       : 8
processor       : 9
processor       : 10
processor       : 11
processor       : 16
processor       : 17
processor       : 18
processor       : 19
processor       : 20
processor       : 21
processor       : 22
processor       : 23
processor       : 24
processor       : 25
processor       : 26
processor       : 27

Code:
root@centimanes:~# pct config 101
arch: amd64
cores: 2
hostname: test
memory: 3072
net0: name=eth0,bridge=vmbr1,gw=10.0.0.1,hwaddr=B6:A0:B3:97:44:00,ip=10.0.0.3/24,type=veth
ostype: debian
rootfs: local-zfs:subvol-101-disk-1,size=16G
swap: 512

Code:
root@centimanes:~# pct cpusets
no running containers
 
Last edited:
I do have the same error on starting any container.

HP Proliant ML350 G6
Intel(R) Xeon(R) CPU 2x L5630 @ 2.13GHz

Virtual Environment 5.0-5/c155b5bc
 
The fix you made did work.

I changed repo to experimental and got my containers working !
It would be a great idea to update the Beta ISO to have the latest version.

I used this repo, not for production, but ok for my home lab.
deb http://download.proxmox.com/debian stretch pvetest

Virtual Environment 5.0-9/c7bdd872

Thanks
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!