Repeating Error In Syslog

[toomanylogins]

I have this error in syslog. From logs it started about 10 days ago but nothing has changed. On version 7.0.11

Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.280975] kvm_set_msr_common: 14606 callbacks suppressed
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.280981] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.282868] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.283129] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.283273] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.283582] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.283759] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.283901] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.284035] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.284166] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:31 rx300s7-1-pve kernel: [35754.284345] kvm [2137]: vcpu0, guest rIP: 0xfffff80524ff9812 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop
Dec  9 16:28:35 rx300s7-1-pve pvestatd[1561]: pbs: error fetching datastores - 500 Can't connect to 10.10.1.51:8007 (No route to host)

Log is growing 65mb in a week. Other than that all ok. I dont think related to last line as pbs backup server has always been off for part of day.
Is this a particular guest ?
Thanks
Paul

 

[fiona]

Hi,
please post the output of pveversion -v and cat /proc/2137/cmdline. If there is no such file, try using ps aux and guess from the processes close to 2137 which guest it might be. What CPU model do you have?

 

[toomanylogins]

Thanks for reply. This is a dual xeon v1 server. Here is version.

proxmox-ve: 7.0-2 (running kernel: 5.11.22-4-pve)
pve-manager: 7.0-11 (running version: 7.0-11/63d82f4e)
pve-kernel-5.11: 7.0-7
pve-kernel-helper: 7.0-7
pve-kernel-5.11.22-4-pve: 5.11.22-8
ceph-fuse: 15.2.14-pve1
corosync: 3.1.2-pve2
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx3
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.21-pve1
libproxmox-acme-perl: 1.3.0
libproxmox-backup-qemu0: 1.2.0-1
libpve-access-control: 7.0-4
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.0-6
libpve-guest-common-perl: 4.0-2
libpve-http-server-perl: 4.0-2
libpve-storage-perl: 7.0-10
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 4.0.9-4
lxcfs: 4.0.8-pve2
novnc-pve: 1.2.0-3
proxmox-backup-client: 2.0.9-2
proxmox-backup-file-restore: 2.0.9-2
proxmox-mini-journalreader: 1.2-1
proxmox-widget-toolkit: 3.3-6
pve-cluster: 7.0-3
pve-container: 4.0-9
pve-docs: 7.0-5
pve-edk2-firmware: 3.20200531-1
pve-firewall: 4.2-2
pve-firmware: 3.3-1
pve-ha-manager: 3.3-1
pve-i18n: 2.5-1
pve-qemu-kvm: 6.0.0-3
pve-xtermjs: 4.12.0-1
qemu-server: 7.0-13
smartmontools: 7.2-1
spiceterm: 3.2-2
vncterm: 1.7-1
zfsutils-linux: 2.0.5-pve1

I do get no such file. However the error is process 2144 in syslog today and ps aux gives me process id 2144 and guest number which is a windows 10 guest. I'll check config. It looks like this is my only guest where cpu is set to qemu64 as I get ablue screen when I set it to host. So issue with guest.

Thanks

 

[fiona]

I do get no such file. However the error is process 2144 in syslog today and ps aux gives me process id 2144 and guest number which is a windows 2019 server. I'll check config. It looks like this is my only guest where cpu is set to host.

Yes, when CPU type is host, kvm does more things, so that could be why it triggered there. In any case, I'd recommend updating (see here for how to configure repositories in case you haven't). Proxmox VE 7.0 was released 1.5 years ago and kernel 5.11 does not receive any updates/fixes any more.

 

[toomanylogins]

Thanks Fiona, I will update over Christmas.
I have pci passthrough running and I was wary of update to due to so many messages about passthrough and new kernel.

 

[fiona]

The 5.15 kernel is the default one currently, but you can also install the 5.19. If there really are passthrough issues with both of them, you can still install/boot older kernels, but as I said, those won't get updates. But at least you have updates for everything else

 

[toomanylogins]

I have updated to version 7.3 with kernel 5.15 and I am still getting this error repeating in syslog.

Jan 15 17:40:21 rx300s7-1-pve kernel: [11464.313352] kvm [2210]: vcpu0, guest rIP: 0xfffff803397fa712 vmx_set_msr: BTF|LBR in IA32_DEBUGCTLMSR 0x1, nop

It is the same win 10 guest with cpu set to qemu64 and machine type is q53 7.1

Any further suggestions ?

 

[fiona]

Hi,
I think you can safely ignore this message (there are a lot of reports and it seems to just be about a specific debug instruction not being supported by the vCPU). Otherwise see here for a potential workaround.

 

[toomanylogins]

Updated to 7.4.3 This error is still filling up the syslog. Its the same Win10 guest with cpu set to qemu64

kernel: [ 7883.754609] kvm [11636]: vcpu0, guest rIP: 0xfffff800295fc152 vmx_set_msr: BTF|LBR in IA32_DEBUGCTLMSR 0x1, nop

 

[fiona]

Updated to 7.4.3 This error is still filling up the syslog. Its the same Win10 guest with cpu set to qemu64

kernel: [ 7883.754609] kvm [11636]: vcpu0, guest rIP: 0xfffff800295fc152 vmx_set_msr: BTF|LBR in IA32_DEBUGCTLMSR 0x1, nop

Did you try the workaround I linked to?

 

[toomanylogins]

I tried but I do not have a file kvm.conf in etc/modprobe.d Unsure whether to create new one or not ?
Thanks
Paul

 

[fiona]

Yes, then you'll need to create it first.

 

[toomanylogins]

Included the kvm.conf rebooted. The error has an extra line re callbacks but still present in both the syslog and the kern.log..

Apr 17 11:48:24 rx300s7-1-pve kernel: [ 1828.932183] vmx_set_msr: 461 callbacks suppressed
Apr 17 11:48:24 rx300s7-1-pve kernel: [ 1828.932189] kvm [2339]: vcpu2, guest rIP: 0xfffff80506dfc152 vmx_set_msr: BTF|LBR in IA32_DEBUGCTLMSR 0x1, nop

Regards
Paul

 

[buck2825]

@toomanylogins ,
have you managed to resolve this issue? I'm having the same issue on a windows 10 VM.