Hello.
We just installed Proxmox Cluster from 4 nodes. We have mounted NFS storage from NETAPP to use in Proxmox.
Launched some instances and we see 2 of 4 nodes have issue with NFS storage and every 20-60 minutes we see these errors in the journalctl -u pvestatd --no-pager -n 200
We use INTEL 10G SFP+ network cards with DAC cables.
Servers Dell R640
Using NFS v3 - options vers=3,rsize=65536,wsize=65536,proto=tcp,timeo=600,retrans=3
Anybody has this issue before? Ping is working fine. Netapp storage is working with 10%-20% load it servers other UBUNTU and XENSERVER clients with no issues.
Kernel information:
Linux proxmox01 6.8.12-9-pve #1 SMP PREEMPT_DYNAMIC PMX 6.8.12-9 (2025-03-16T19:18Z) x86_64 GNU/Linux
Proxmox 8.4.0
We just installed Proxmox Cluster from 4 nodes. We have mounted NFS storage from NETAPP to use in Proxmox.
Launched some instances and we see 2 of 4 nodes have issue with NFS storage and every 20-60 minutes we see these errors in the journalctl -u pvestatd --no-pager -n 200
PHP:
Oct 16 17:41:40 proxmox03 pvestatd[5251]: status update time (9.203 seconds)
Oct 16 18:21:41 proxmox03 pvestatd[5251]: storage 'PROXMOX-SATA-1' is not online
Oct 16 18:21:51 proxmox03 pvestatd[5251]: storage 'PROXMOX_SSD_1' is not online
Oct 16 18:21:51 proxmox03 pvestatd[5251]: status update time (20.233 seconds)
Oct 16 18:21:57 proxmox03 pvestatd[5251]: got timeout
Oct 16 18:21:57 proxmox03 pvestatd[5251]: unable to activate storage 'PROXMOX_SSD_1' - directory '/mnt/pve/PROXMOX_SSD_1' does not exist or is unreachable
Oct 16 18:21:57 proxmox03 pvestatd[5251]: status update time (5.341 seconds)
Oct 16 18:22:03 proxmox03 pvestatd[5251]: got timeout
Oct 16 18:22:03 proxmox03 pvestatd[5251]: unable to activate storage 'PROXMOX_SSD_1' - directory '/mnt/pve/PROXMOX_SSD_1' does not exist or is unreachable
Oct 16 18:22:13 proxmox03 pvestatd[5251]: got timeout
Oct 16 18:22:13 proxmox03 pvestatd[5251]: unable to activate storage 'PROXMOX_SSD_1' - directory '/mnt/pve/PROXMOX_SSD_1' does not exist or is unreachable
Oct 16 18:37:01 proxmox03 pvestatd[5251]: storage 'PROXMOX_SSD_1' is not online
Oct 16 18:37:11 proxmox03 pvestatd[5251]: storage 'PROXMOX-SATA-1' is not online
Oct 16 18:37:12 proxmox03 pvestatd[5251]: status update time (20.242 seconds)
Oct 16 18:37:22 proxmox03 pvestatd[5251]: storage 'PROXMOX_SSD_1' is not online
Oct 16 18:37:22 proxmox03 pvestatd[5251]: status update time (10.256 seconds)
Oct 16 18:46:15 proxmox03 systemd[1]: Stopping pvestatd.service - PVE Status Daemon...
Oct 16 18:46:16 proxmox03 pvestatd[5251]: received signal TERM
Oct 16 18:46:16 proxmox03 pvestatd[5251]: server closing
Oct 16 18:46:16 proxmox03 pvestatd[5251]: server stopped
Oct 16 18:46:17 proxmox03 systemd[1]: pvestatd.service: Deactivated successfully.
Oct 16 18:46:17 proxmox03 systemd[1]: Stopped pvestatd.service - PVE Status Daemon.
Oct 16 18:46:17 proxmox03 systemd[1]: pvestatd.service: Consumed 34min 41.046s CPU time.
Oct 16 18:46:17 proxmox03 systemd[1]: Starting pvestatd.service - PVE Status Daemon...
Oct 16 18:46:17 proxmox03 pvestatd[616102]: starting server
Oct 16 18:46:18 proxmox03 systemd[1]: Started pvestatd.service - PVE Status Daemon.
Oct 16 18:57:37 proxmox03 pvestatd[616102]: storage 'PROXMOX_SSD_1' is not online
Oct 16 18:57:47 proxmox03 pvestatd[616102]: storage 'PROXMOX-SATA-1' is not online
Oct 16 18:57:47 proxmox03 pvestatd[616102]: status update time (20.256 seconds)
Oct 16 18:57:58 proxmox03 pvestatd[616102]: storage 'PROXMOX-SATA-1' is not online
Oct 16 18:58:07 proxmox03 pvestatd[616102]: got timeout
Oct 16 18:58:07 proxmox03 pvestatd[616102]: unable to activate storage 'PROXMOX_SSD_1' - directory '/mnt/pve/PROXMOX_SSD_1' does not exist or is unreachable
Oct 16 18:58:07 proxmox03 pvestatd[616102]: status update time (19.416 seconds)
Oct 16 18:58:09 proxmox03 pvestatd[616102]: got timeout
Oct 16 18:58:09 proxmox03 pvestatd[616102]: unable to activate storage 'PROXMOX_SSD_1' - directory '/mnt/pve/PROXMOX_SSD_1' does not exist or is unreachable
Oct 16 19:11:48 proxmox03 systemd[1]: Stopping pvestatd.service - PVE Status Daemon...
Oct 16 19:11:49 proxmox03 pvestatd[616102]: received signal TERM
Oct 16 19:11:49 proxmox03 pvestatd[616102]: server closing
Oct 16 19:11:49 proxmox03 pvestatd[616102]: server stopped
Oct 16 19:11:50 proxmox03 systemd[1]: pvestatd.service: Deactivated successfully.
Oct 16 19:11:50 proxmox03 systemd[1]: Stopped pvestatd.service - PVE Status Daemon.
Oct 16 19:11:50 proxmox03 systemd[1]: pvestatd.service: Consumed 35.951s CPU time.
Oct 16 19:11:50 proxmox03 systemd[1]: Starting pvestatd.service - PVE Status Daemon...
Oct 16 19:11:51 proxmox03 pvestatd[625844]: starting server
Oct 16 19:11:51 proxmox03 systemd[1]: Started pvestatd.service - PVE Status Daemon.
Oct 16 19:38:21 proxmox03 pvestatd[625844]: storage 'PROXMOX-SATA-1' is not online
Oct 16 19:38:31 proxmox03 pvestatd[625844]: storage 'PROXMOX_SSD_1' is not online
Oct 16 19:38:31 proxmox03 pvestatd[625844]: status update time (20.240 seconds)
Oct 16 19:38:38 proxmox03 pvestatd[625844]: got timeout
Oct 16 19:38:39 proxmox03 pvestatd[625844]: status update time (7.384 seconds)
Oct 16 19:38:43 proxmox03 pvestatd[625844]: got timeoutWe use INTEL 10G SFP+ network cards with DAC cables.
Servers Dell R640
Using NFS v3 - options vers=3,rsize=65536,wsize=65536,proto=tcp,timeo=600,retrans=3
Anybody has this issue before? Ping is working fine. Netapp storage is working with 10%-20% load it servers other UBUNTU and XENSERVER clients with no issues.
Kernel information:
Linux proxmox01 6.8.12-9-pve #1 SMP PREEMPT_DYNAMIC PMX 6.8.12-9 (2025-03-16T19:18Z) x86_64 GNU/Linux
Proxmox 8.4.0
Last edited: