Proxmox Suddenly Quits

[manjotsc]

Hi,

I have a Proxmox server running about 11 LXCs and 3 VMs, they are divided on two network adapter, first adapter on board LAN and second one is PCIe Network Adapter. After few days of run time, Proxmox server suddenly quits, I lost all access to LXCs and VMs over Network including server it self. I don't know if this a network issue or something else, I need help troubleshooting. Where should I start? When manually rebooting the server, it boots just fine and all LXCs and VMs comes up.

Thanks,
Virtual Environment 7.0-11

 

[dcsapak]

is anything in the logs (dmesg/journalctl)? do you have some kind of remote (ikvm/ilo/etc) or direct (monitor+keyboard) access? if yes, does it still work then?

 

[manjotsc]

I am waiting for it to quit again, I will hookup monitor and mouse and see If I can access it.

Here are logs files, they are huge. Last time the server stopped working was on September 06, 2021 around evening maybe

https://drive.google.com/file/d/11M0Sdq6BWkTAxu1Ip_px6vLWgiaDBdnS/view?usp=sharing Dmesg https://drive.google.com/file/d/1tUk8XErhZ6fsBeVfXc6CYIjOgW-y9DuN/view?usp=sharing Journalctl

 

[manjotsc]

@dcsapak It went down again today, I tried accessing it via monitor and keyboard. But there was no display output of proxmox.

 

[dcsapak]

seems to be either a driver/hardware issue:

[ 4173.875076] e1000e 0000:00:19.0 eno1: Detected Hardware Unit Hang:

means the nic hangs... you could try to use different nics or a newer kernel (if available) to see if either change fixes the issue

 

[manjotsc]

@dcsapak Would this cause the entire system hang or just the network card it self?

 

[dcsapak]

normally only the network card, but if the hardware problem in reality is somewhere else, it might just be a symptom

 

[manjotsc]

@dcsapak eno1 is the onboard network Ethernet Port I am using for LAN Side things, maybe the motherboard is defective?

 

[manjotsc]

@dcsapak Can you help me locate Linux Ethernet Driver for this board I can't find one.

Motherboard: H87-D3H-CF

root@vms:~# lshw -class network
  *-network                 
       description: Ethernet interface
       product: Ethernet Connection I217-V
       vendor: Intel Corporation
       physical id: 19
       bus info: pci@0000:00:19.0
       logical name: eno1
       version: 04
       serial: 94:de:80:7d:58:d3
       size: 1Gbit/s
       capacity: 1Gbit/s
       width: 32 bits
       clock: 33MHz
       capabilities: pm msi bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=5.11.22-4-pve duplex=full firmware=0.13-4 latency=0 link=yes multicast=yes port=twisted pair speed=1Gbit/s
       resources: irq:32 memory:f7b00000-f7b1ffff memory:f7b3d000-f7b3dfff ioport:f080(size=32)

 

[manjotsc]

@dcsapak I found the driver, but don't know the best to install it?

https://www.intel.com/content/www/u...ethernet-network-connections-under-linux.html

 

[manjotsc]

@dcsapak I disabled the onboard NIC (eno1) in BIOS and the issue seems to have been fixed.