Hi,
I have a curious problem where the web interfaces of my Proxmox interface stops listening for connections on IPv4. It has done it a few times. It recovered once with a reboot, but otherwise it is stuck in this state. I can SSH to the server without an issue on IPv4. It is a single node system. Diagnostics below:
Any ideas what to look at?
Netstat -an
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 127.0.0.1:85 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN
tcp 0 0 192.168.202.30:22 192.168.202.37:42866 ESTABLISHED
tcp6 0 0 ::1:25 :::* LISTEN
tcp6 0 0 :::3128 :::* LISTEN
tcp6 0 0 :::111 :::* LISTEN
tcp6 0 0 :::22 :::* LISTEN
tcp6 0 0 :::8006 :::* LISTEN
udp 0 0 0.0.0.0:111 0.0.0.0:*
udp 0 0 127.0.0.1:323 0.0.0.0:*
udp6 0 0 :::111 :::*
udp6 0 0 ::1:323 :::*
systemctl status pveproxy.service
● pveproxy.service - PVE API Proxy Server
Loaded: loaded (/lib/systemd/system/pveproxy.service; enabled; preset: enabled)
Active: active (running) since Tue 2024-12-10 07:28:23 GMT; 2 days ago
Process: 280833 ExecReload=/usr/bin/pveproxy restart (code=exited, status=0/SUCCESS)
Main PID: 1198 (pveproxy)
Tasks: 4 (limit: 38016)
Memory: 154.9M
CPU: 20.957s
CGroup: /system.slice/pveproxy.service
├─ 1198 pveproxy
├─280904 "pveproxy worker"
├─280905 "pveproxy worker"
└─280906 "pveproxy worker"
Dec 11 00:00:03 proxmox pveproxy[1198]: starting 3 worker(s)
Dec 11 00:00:03 proxmox pveproxy[1198]: worker 280904 started
Dec 11 00:00:03 proxmox pveproxy[1198]: worker 280905 started
Dec 11 00:00:03 proxmox pveproxy[1198]: worker 280906 started
Dec 11 00:00:08 proxmox pveproxy[96327]: worker exit
Dec 11 00:00:08 proxmox pveproxy[96326]: worker exit
Dec 11 00:00:08 proxmox pveproxy[96328]: worker exit
Dec 11 00:00:08 proxmox pveproxy[1198]: worker 96327 finished
Dec 11 00:00:08 proxmox pveproxy[1198]: worker 96326 finished
Dec 11 00:00:08 proxmox pveproxy[1198]: worker 96328 finished
lsof -i:8006
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
pveproxy 1198 www-data 6u IPv6 6090 0t0 TCP *:8006 (LISTEN)
pveproxy 280904 www-data 6u IPv6 6090 0t0 TCP *:8006 (LISTEN)
pveproxy 280905 www-data 6u IPv6 6090 0t0 TCP *:8006 (LISTEN)
pveproxy 280906 www-data 6u IPv6 6090 0t0 TCP *:8006 (LISTEN)
cat /proc/sys/net/ipv6/bindv6only
0
pve-manager/8.3.1/fb48e850ef9dde27 (running kernel: 6.8.12-2-pve)
ss -tlpn
State Recv-Q Send-Q Local Addressort Peer Addressort Process
LISTEN 0 4096 127.0.0.1:85 0.0.0.0:* users("pvedaemon worke",pid=96316,fd=6),("pvedaemon worke",pid=96315,fd=6),("pvedaemon worke",pid=96314,fd=6),("pvedaemon",pid=1189,fd=6))
LISTEN 0 100 127.0.0.1:25 0.0.0.0:* users("master",pid=1129,fd=13))
LISTEN 0 4096 0.0.0.0:111 0.0.0.0:* users("rpcbind",pid=792,fd=4),("systemd",pid=1,fd=108))
LISTEN 0 128 0.0.0.0:22 0.0.0.0:* users("sshd",pid=952,fd=3))
LISTEN 0 100 [::1]:25 [::]:* users("master",pid=1129,fd=14))
LISTEN 0 4096 *:3128 *:* users("spiceproxy work",pid=280896,fd=6),("spiceproxy",pid=1204,fd=6))
LISTEN 0 4096 [::]:111 [::]:* users("rpcbind",pid=792,fd=6),("systemd",pid=1,fd=110))
LISTEN 0 128 [::]:22 [::]:* users("sshd",pid=952,fd=4))
LISTEN 0 4096 *:8006 *:* users("pveproxy worker",pid=280906,fd=6),("pveproxy worker",pid=280905,fd=6),("pveproxy worker",pid=280904,fd=6),("pveproxy",pid=1198,fd=6))
cat access.log.1 (current access.log is empty)
::ffff:192.168.202.36 - - [10/12/2024:06:54:16 +0000] "GET / HTTP/1.1" 200 886
I have a curious problem where the web interfaces of my Proxmox interface stops listening for connections on IPv4. It has done it a few times. It recovered once with a reboot, but otherwise it is stuck in this state. I can SSH to the server without an issue on IPv4. It is a single node system. Diagnostics below:
Any ideas what to look at?
Netstat -an
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 127.0.0.1:85 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN
tcp 0 0 192.168.202.30:22 192.168.202.37:42866 ESTABLISHED
tcp6 0 0 ::1:25 :::* LISTEN
tcp6 0 0 :::3128 :::* LISTEN
tcp6 0 0 :::111 :::* LISTEN
tcp6 0 0 :::22 :::* LISTEN
tcp6 0 0 :::8006 :::* LISTEN
udp 0 0 0.0.0.0:111 0.0.0.0:*
udp 0 0 127.0.0.1:323 0.0.0.0:*
udp6 0 0 :::111 :::*
udp6 0 0 ::1:323 :::*
systemctl status pveproxy.service
● pveproxy.service - PVE API Proxy Server
Loaded: loaded (/lib/systemd/system/pveproxy.service; enabled; preset: enabled)
Active: active (running) since Tue 2024-12-10 07:28:23 GMT; 2 days ago
Process: 280833 ExecReload=/usr/bin/pveproxy restart (code=exited, status=0/SUCCESS)
Main PID: 1198 (pveproxy)
Tasks: 4 (limit: 38016)
Memory: 154.9M
CPU: 20.957s
CGroup: /system.slice/pveproxy.service
├─ 1198 pveproxy
├─280904 "pveproxy worker"
├─280905 "pveproxy worker"
└─280906 "pveproxy worker"
Dec 11 00:00:03 proxmox pveproxy[1198]: starting 3 worker(s)
Dec 11 00:00:03 proxmox pveproxy[1198]: worker 280904 started
Dec 11 00:00:03 proxmox pveproxy[1198]: worker 280905 started
Dec 11 00:00:03 proxmox pveproxy[1198]: worker 280906 started
Dec 11 00:00:08 proxmox pveproxy[96327]: worker exit
Dec 11 00:00:08 proxmox pveproxy[96326]: worker exit
Dec 11 00:00:08 proxmox pveproxy[96328]: worker exit
Dec 11 00:00:08 proxmox pveproxy[1198]: worker 96327 finished
Dec 11 00:00:08 proxmox pveproxy[1198]: worker 96326 finished
Dec 11 00:00:08 proxmox pveproxy[1198]: worker 96328 finished
lsof -i:8006
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
pveproxy 1198 www-data 6u IPv6 6090 0t0 TCP *:8006 (LISTEN)
pveproxy 280904 www-data 6u IPv6 6090 0t0 TCP *:8006 (LISTEN)
pveproxy 280905 www-data 6u IPv6 6090 0t0 TCP *:8006 (LISTEN)
pveproxy 280906 www-data 6u IPv6 6090 0t0 TCP *:8006 (LISTEN)
cat /proc/sys/net/ipv6/bindv6only
0
pve-manager/8.3.1/fb48e850ef9dde27 (running kernel: 6.8.12-2-pve)
ss -tlpn
State Recv-Q Send-Q Local Addressort Peer Addressort Process
LISTEN 0 4096 127.0.0.1:85 0.0.0.0:* users("pvedaemon worke",pid=96316,fd=6),("pvedaemon worke",pid=96315,fd=6),("pvedaemon worke",pid=96314,fd=6),("pvedaemon",pid=1189,fd=6))
LISTEN 0 100 127.0.0.1:25 0.0.0.0:* users("master",pid=1129,fd=13))
LISTEN 0 4096 0.0.0.0:111 0.0.0.0:* users("rpcbind",pid=792,fd=4),("systemd",pid=1,fd=108))
LISTEN 0 128 0.0.0.0:22 0.0.0.0:* users("sshd",pid=952,fd=3))
LISTEN 0 100 [::1]:25 [::]:* users("master",pid=1129,fd=14))
LISTEN 0 4096 *:3128 *:* users("spiceproxy work",pid=280896,fd=6),("spiceproxy",pid=1204,fd=6))
LISTEN 0 4096 [::]:111 [::]:* users("rpcbind",pid=792,fd=6),("systemd",pid=1,fd=110))
LISTEN 0 128 [::]:22 [::]:* users("sshd",pid=952,fd=4))
LISTEN 0 4096 *:8006 *:* users("pveproxy worker",pid=280906,fd=6),("pveproxy worker",pid=280905,fd=6),("pveproxy worker",pid=280904,fd=6),("pveproxy",pid=1198,fd=6))
cat access.log.1 (current access.log is empty)
::ffff:192.168.202.36 - - [10/12/2024:06:54:16 +0000] "GET / HTTP/1.1" 200 886