Issue wtih connections to Storage

[mikey00]

So i recently setup and installed a Proxmox server (If you need specs let me know)
i have 8 VMs running from linux and windows servers and clietns that are all working as intended.
I even have a firewall set as Priority boot order so that it boots first before anything else this way we have no issues with routing.

The problem is for some reason as of late the Proxmox gui loses connection to everything. All VMs are up running just fine but the GUI keeps showing Questions marks next to everything or if i click on one that doesnt it eventually gets a connection timeout error.

This happened when i changed the ip that the server resided on. The gui and the server both show the correct ip so i dont think thats the issue but im not sure.
has anyone experienced this problem and know of any fixes?

If I reboot the server it works fine for a few minutes then its back to doing the same thing. I cannot keep rebooting the Host server as this hosts all my servers including my firewall for my network.

 

[aaron]

Did you change the IP address in /etc/hosts as well?

Other than that, is there anything in the syslogs?

 

[mikey00]

Did you change the IP address in /etc/hosts as well?

Other than that, is there anything in the syslogs?

yes i did, i also cannot get the syslog in the gui to pull up where is the location of the file so i can access on the server itself ?

 

[aaron]

The syslog is located at /var/log/syslog.

 

[mikey00]

It just keeps repeating this over and over

Dec 28 01:48:00 MyVVM systemd[1]: Starting Proxmox VE replication runner...
Dec 28 01:48:01 MyVVM systemd[1]: pvesr.service: Succeeded.
Dec 28 01:48:01 MyVVM systemd[1]: Started Proxmox VE replication runner.
Dec 28 01:48:01 MyVVM kernel: [31182.457616] usb 6-1.2: reset SuperSpeed Gen 1 USB device number 4 using xhci_hcd
Dec 28 01:48:21 MyVVM kernel: [31202.847251] xhci_hcd 0000:29:00.4: WARN Cannot submit Set TR Deq Ptr
Dec 28 01:48:21 MyVVM kernel: [31202.847254] xhci_hcd 0000:29:00.4: A Set TR Deq Ptr command is pending.
Dec 28 01:48:21 MyVVM kernel: [31202.927340] usb 6-1.4: reset SuperSpeed Gen 1 USB device number 6 using xhci_hcd
Dec 28 01:48:34 MyVVM kernel: [31215.209123] usb 6-1.2: reset SuperSpeed Gen 1 USB device number 4 using xhci_hcd
Dec 28 01:48:52 MyVVM kernel: [31233.551767] xhci_hcd 0000:29:00.4: WARN Cannot submit Set TR Deq Ptr
Dec 28 01:48:52 MyVVM kernel: [31233.551769] xhci_hcd 0000:29:00.4: A Set TR Deq Ptr command is pending.
Dec 28 01:48:52 MyVVM kernel: [31233.631834] usb 6-1.4: reset SuperSpeed Gen 1 USB device number 6 using xhci_hcd
Dec 28 01:49:00 MyVVM systemd[1]: Starting Proxmox VE replication runner...
Dec 28 01:49:01 MyVVM systemd[1]: pvesr.service: Succeeded.
Dec 28 01:49:01 MyVVM systemd[1]: Started Proxmox VE replication runner.

 

[mikey00]

i did find an error about cpu c State so i disabled that in bios and running again to see if it timesout again. i will report back later today.

 

[mikey00]

for the record if you see these errors in your syslog this means the cpu is sorta going into power save mode. disabling this got rid of the alerts but im not sure yet if this solved the connection problem as well. currently its lasted over 10 minutes where i can see everything and thats the longest its lasted so i will report tomorrow if i can still see everything

Uhhuh. NMI received for unknown reason 21 on CPU 1.
Do you have a strange power saving mode enabled?
Dazed and confused, but trying to continue

 

[mikey00]

so this lasted almost an hour but now its back to where i can no longer see storage.

If i click on the storage container it just says loading then eventually a connection timeout error. The main cluster (datacenter) says


half the things i click on in the host itself fail to load including console connections to vms. If i use RDP for my windows machines and SSH for the linux machines i can communicate with everything just fine. even my nas storage works fine. the only issue is for whatever reason the Proxmox Web Gui is not communicating to anything like it should. the syslog now shows nothing but the replication loop. im not sure what else could be causing this. the only change that was made is a network ip change from a subnet 85 to 1 thats it the rest of the ip stayed the same. it was changed in both the hosts file and i changed the interface from 0 to 1 so it was assigned to the other NIC Card which i moved it to the Second Nic card.j

Not sure if this helps

 

[aaron]

hmm, should have asked that earlier but there should be newer updates available.

Try to install the latest updates and please check again.

 

[mikey00]

i just ran the updates last night it didnt find anything new i guess

 

[aaron]

Well, according to the screenshot you run pve-manager 6.3-2. But 6.3-3 is the current version.

If you don't see that update, please show the output when you run apt update. Might be that some repository configuration is not correct.

 

[mikey00]

so the update updated the pve manager successfully but the issue remains i even restart pveproxy again and that did nothing.

 

[mikey00]

i reverted my network changes and the issue still remains so its not tied to network.

 

[mikey00]

so its something with pveproxy failing to communicate if i restart pveproxy i get my connections back temporarily but then it fails again after a few mintues.

 

[mikey00]

bumping this topic because im still having problems with this