[SOLVED] nfs mount failed

K

k-123

Well-Known Member
Mar 3, 2017
50
4
48
the nfs share can be manually mount in the pve host by command "mount -t nfs4 172.16.0.31:/export/nfs-pve" , but auto mount failed.

nfs share is configured in cluster - storage.

nfs server side option is anongid=100, anonuid=100, insecure, no_root_squash, rw, subtree_check

1706670240866.png

1706670394260.png
pve-5 pvestatd[1085]: mount error: mount.nfs: mounting 172.16.0.31:/export/nfs-pve failed, reason given by server: No such file or directory
Click to expand...

tried this method did not help. https://forum.proxmox.com/threads/could-not-mount-nfs-storage.102042/post-439864

root@pve-5:~# pveversion -v
proxmox-ve: 7.4-1 (running kernel: 5.15.131-2-pve)
pve-manager: 7.4-17 (running version: 7.4-17/513c62be)
pve-kernel-5.15: 7.4-9
pve-kernel-5.15.131-2-pve: 5.15.131-3
pve-kernel-5.15.102-1-pve: 5.15.102-1
ceph-fuse: 15.2.17-pve1
corosync: 3.1.7-pve1
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx4
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve2
libproxmox-acme-perl: 1.4.4
libproxmox-backup-qemu0: 1.3.1-1
libproxmox-rs-perl: 0.2.1
libpve-access-control: 7.4.1
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.4-2
libpve-guest-common-perl: 4.2-4
libpve-http-server-perl: 4.2-3
libpve-rs-perl: 0.7.7
libpve-storage-perl: 7.4-3
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.2-2
lxcfs: 5.0.3-pve1
novnc-pve: 1.4.0-1
proxmox-backup-client: 2.4.4-1
proxmox-backup-file-restore: 2.4.4-1
proxmox-kernel-helper: 7.4-1
proxmox-mail-forward: 0.1.1-1
proxmox-mini-journalreader: 1.3-1
proxmox-widget-toolkit: 3.7.3
pve-cluster: 7.3-3
pve-container: 4.4-6
pve-docs: 7.4-2
pve-edk2-firmware: 3.20230228-4~bpo11+1
pve-firewall: 4.3-5
pve-firmware: 3.6-6
pve-ha-manager: 3.6.1
pve-i18n: 2.12-1
pve-qemu-kvm: 7.2.0-8
pve-xtermjs: 4.16.0-2
qemu-server: 7.4-4
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.8.0~bpo11+3
vncterm: 1.7-1
zfsutils-linux: 2.1.14-pve1
Click to expand...
 
there are 6 nodes in cluster ( going to replace a old node with pve-5. other 5 nodes can mount the nfs share automatically. )
 
Hi,
please share the output of cat /etc/pve/storage.cfg and the relevant line from cat /proc/mounts on a node where the mount does work. Does that node run the same kernel and same version of libpve-storage-perl?
 
libpve-storage-perl are same. node 1/2/3/4/6 have upgrade to same version, but did not reboot yet ( the omv-1 nfs share has mounted 200+ days on 1/2/3/4/6 nodes). nfs server is openmediavault 6.

storage.cfg
root@pve-5:~# cat /etc/pve/storage.cfg
dir: local
path /var/lib/vz
content vztmpl,iso,backup

lvmthin: local-lvm
thinpool data
vgname pve
content rootdir,images

dir: drive2
path /mnt/drive2
content vztmpl,images,iso,rootdir
nodes pve-1
prune-backups keep-all=1
shared 0

nfs: dsm02
export /volume1/nfs-pve
path /mnt/pve/dsm02
server 172.16.0.20
content snippets,vztmpl,iso,backup,images,rootdir
options vers=4
prune-backups keep-all=1

nfs: dsm05
export /volume1/nfs-pve
path /mnt/pve/dsm05
server 172.16.0.25
content rootdir,snippets,images
prune-backups keep-all=1

pbs: pbs1
datastore pbs1
server pbs1.posbit.com
content backup
fingerprint b7:65:ae:9d:55:f4:81:95:0a:26:7e:2c:fb:4b:8c:a9:52:74:54:65:91:44:03:bf:b4:fb:13:6c:9d:22:0a:05
prune-backups keep-all=1
username pbs1@pbs

pbs: pbs2
datastore data
server pbs2.posbit.com
content backup
fingerprint b7:65:ae:9d:55:f4:81:95:0a:26:7e:2c:fb:4b:8c:a9:52:74:54:65:91:44:03:bf:b4:fb:13:6c:9d:22:0a:05
prune-backups keep-all=1
username pbs2@pbs

pbs: pbs2-ssd
datastore ssd
server pbs2.posbit.com
content backup
fingerprint b7:65:ae:9d:55:f4:81:95:0a:26:7e:2c:fb:4b:8c:a9:52:74:54:65:91:44:03:bf:b4:fb:13:6c:9d:22:0a:05
prune-backups keep-all=1
username pbs2@pbs

lvmthin: local2
thinpool local2
vgname local2
content images,rootdir
nodes pve-6

nfs: omv-1
export /export/nfs-pve
path /mnt/pve/omv-1
server 172.16.0.31
content rootdir,images
options vers=4.2
prune-backups keep-all=1
Click to expand...

mounts
root@pve-5:~# cat /proc/mounts
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,relatime 0 0
udev /dev devtmpfs rw,nosuid,relatime,size=24426252k,nr_inodes=6106563,mode=755,inode64 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=4892912k,mode=755,inode64 0 0
/dev/mapper/pve-root / ext4 rw,relatime,errors=remount-ro 0 0
securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0
tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0
cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime 0 0
pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0
efivarfs /sys/firmware/efi/efivars efivarfs rw,nosuid,nodev,noexec,relatime 0 0
bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0
systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=32896 0 0
hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0
mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0
debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0
tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0
configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0
fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0
sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0
/dev/nvme0n1p2 /boot/efi vfat rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro 0 0
lxcfs /var/lib/lxcfs fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
/dev/fuse /etc/pve fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other 0 0
172.16.0.20:/volume1/nfs-pve /mnt/pve/dsm02 nfs4 rw,relatime,vers=4.0,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=172.16.2.5,local_lock=none,addr=172.16.0.20 0 0
172.16.0.25:/volume1/nfs-pve /mnt/pve/dsm05 nfs4 rw,relatime,vers=4.1,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=172.16.2.5,local_lock=none,addr=172.16.0.25 0 0
tmpfs /run/user/0 tmpfs rw,nosuid,nodev,relatime,size=4892908k,nr_inodes=1223227,mode=700,inode64 0 0
Click to expand...
 
above post of pve-5 is did not worked. below is pve-4 worked.

root@pve-4:~# cat /etc/pve/storage.cfg
dir: local
path /var/lib/vz
content vztmpl,iso,backup

lvmthin: local-lvm
thinpool data
vgname pve
content rootdir,images

dir: drive2
path /mnt/drive2
content vztmpl,images,iso,rootdir
nodes pve-1
prune-backups keep-all=1
shared 0

nfs: dsm02
export /volume1/nfs-pve
path /mnt/pve/dsm02
server 172.16.0.20
content snippets,vztmpl,iso,backup,images,rootdir
options vers=4
prune-backups keep-all=1

nfs: dsm05
export /volume1/nfs-pve
path /mnt/pve/dsm05
server 172.16.0.25
content rootdir,snippets,images
prune-backups keep-all=1

pbs: pbs1
datastore pbs1
server pbs1.posbit.com
content backup
fingerprint b7:65:ae:9d:55:f4:81:95:0a:26:7e:2c:fb:4b:8c:a9:52:74:54:65:91:44:03:bf:b4:fb:13:6c:9d:22:0a:05
prune-backups keep-all=1
username pbs1@pbs

pbs: pbs2
datastore data
server pbs2.posbit.com
content backup
fingerprint b7:65:ae:9d:55:f4:81:95:0a:26:7e:2c:fb:4b:8c:a9:52:74:54:65:91:44:03:bf:b4:fb:13:6c:9d:22:0a:05
prune-backups keep-all=1
username pbs2@pbs

pbs: pbs2-ssd
datastore ssd
server pbs2.posbit.com
content backup
fingerprint b7:65:ae:9d:55:f4:81:95:0a:26:7e:2c:fb:4b:8c:a9:52:74:54:65:91:44:03:bf:b4:fb:13:6c:9d:22:0a:05
prune-backups keep-all=1
username pbs2@pbs

lvmthin: local2
thinpool local2
vgname local2
content images,rootdir
nodes pve-6

nfs: omv-1
export /export/nfs-pve
path /mnt/pve/omv-1
server 172.16.0.31
content rootdir,images
options vers=4.2
prune-backups keep-all=1
Click to expand...

root@pve-4:~# cat /proc/mounts
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,relatime 0 0
udev /dev devtmpfs rw,nosuid,relatime,size=16352424k,nr_inodes=4088106,mode=755,inode64 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3277920k,mode=755,inode64 0 0
/dev/mapper/pve-root / ext4 rw,relatime,errors=remount-ro 0 0
securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0
tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0
cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime 0 0
pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0
efivarfs /sys/firmware/efi/efivars efivarfs rw,nosuid,nodev,noexec,relatime 0 0
bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0
systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18913 0 0
mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0
hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0
debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0
tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0
fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0
configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0
sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0
/dev/sda2 /boot/efi vfat rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro 0 0
lxcfs /var/lib/lxcfs fuse.lxcfs rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0
/dev/fuse /etc/pve fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other 0 0
172.16.0.20:/volume1/nfs-pve /mnt/pve/dsm02 nfs4 rw,relatime,vers=4.0,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=172.16.2.4,local_lock=none,addr=172.16.0.20 0 0
172.16.0.25:/volume1/nfs-pve /mnt/pve/dsm05 nfs4 rw,relatime,vers=4.1,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=172.16.2.4,local_lock=none,addr=172.16.0.25 0 0
172.16.0.31:/export/nfs-pve /mnt/pve/omv-1 nfs rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=172.16.0.31,mountvers=3,mountport=42016,mountproto=udp,local_lock=none,addr=172.16.0.31 0 0
tmpfs /run/user/0 tmpfs rw,nosuid,nodev,relatime,size=3277916k,nr_inodes=819479,mode=700,inode64 0 0
Click to expand...
 
just found this in dmesg of pve-5

[ 2134.685547] FS-Cache: Duplicate cookie detected
[ 2134.685563] FS-Cache: O-cookie c=00000174 [p=00000002 fl=222 nc=0 na=1]
[ 2134.685571] FS-Cache: O-cookie d=0000000056943ef5{NFS.server} n=000000007c93ba03
[ 2134.685581] FS-Cache: O-key=[16] '040000000200000002000801ac10001f'
[ 2134.685591] FS-Cache: N-cookie c=00000175 [p=00000002 fl=2 nc=0 na=1]
[ 2134.685599] FS-Cache: N-cookie d=0000000056943ef5{NFS.server} n=00000000ca33bc50
[ 2134.685609] FS-Cache: N-key=[16] '040000000200000002000801ac10001f'
[ 9834.737315] FS-Cache: Duplicate cookie detected
[ 9834.737332] FS-Cache: O-cookie c=00000681 [p=00000002 fl=222 nc=0 na=1]
[ 9834.737342] FS-Cache: O-cookie d=0000000056943ef5{NFS.server} n=000000000cfbaeec
[ 9834.737353] FS-Cache: O-key=[16] '040000000200000002000801ac10001f'
[ 9834.737365] FS-Cache: N-cookie c=00000682 [p=00000002 fl=2 nc=0 na=1]
[ 9834.737373] FS-Cache: N-cookie d=0000000056943ef5{NFS.server} n=00000000dd1d1670
[ 9834.737383] FS-Cache: N-key=[16] '040000000200000002000801ac10001f'
Click to expand...
 
Code: 
nfs: omv-1
   export /export/nfs-pve
   path /mnt/pve/omv-1
   server 172.16.0.31
   content rootdir,images
   options vers=4.2
   prune-backups keep-all=1
The version is set to 4.2 in the configuration.

Code: 
172.16.0.31:/export/nfs-pve /mnt/pve/omv-1 nfs rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=172.16.0.31,mountvers=3,mountport=42016,mountproto=udp,local_lock=none,addr=172.16.0.31 0 0
But it's mounted with vers=3 on the node pve-4. Are you sure it supports version 4.2? Did you change the configuration recently?
 
fiona said:
Are you sure it supports version 4.2? Did you change the configuration recently?
Click to expand...

yes, server is omv6, on nfs server :
root@omv-1:~# cat /proc/fs/nfsd/versions
-2 +3 +4 +4.1 +4.2
Click to expand...
server has not upgrade recently, have tried recreate export rule. (same parameter as before), that is after issue noticed. assigned to 172.16.2.0/29.
 
after change version to 3 in cluster storage, now pve-5 nfs mount works. thank you @fiona .

seems is omv side issue, test on my station it's actually v3. v4 not work either.
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back