You have a network problem. When investigating a network issue, there are three major components to consider: the Server (NFS), the Intermediate devices (NIC, cable, switch), and the Client (PVE).
PVE performs frequent health checks on NFS storage by running various RPC commands (e.g. rpcinfo...