Syntax nfs4 /etc/export ?

[czechsys]

Hi,

i am struggling with this problem:

Apr  7 11:22:50 pve-01 pvestatd[31628]: Use of uninitialized value in concatenation (.) or string at /usr/share/perl5/PVE/Tools.pm line 849.
Apr  7 11:22:50 pve-01 pvestatd[31628]: Use of uninitialized value in concatenation (.) or string at /usr/share/perl5/PVE/Tools.pm line 849.
Apr  7 11:22:50 pve-01 pvestatd[31628]: Use of uninitialized value in concatenation (.) or string at /usr/share/perl5/PVE/Tools.pm line 849.
Apr  7 11:22:50 pve-01 pvestatd[1948]: Argument "" isn't numeric in int at /usr/share/perl5/PVE/Tools.pm line 862, <GEN4464802> line 1.
Apr  7 11:22:50 pve-01 pvestatd[1948]: Argument "" isn't numeric in int at /usr/share/perl5/PVE/Tools.pm line 863, <GEN4464802> line 2.
Apr  7 11:22:50 pve-01 pvestatd[1948]: Argument "" isn't numeric in int at /usr/share/perl5/PVE/Tools.pm line 864, <GEN4464802> line 3.
Apr  7 11:23:00 pve-01 pvestatd[1948]: mkdir /mnt/pve/nfs_proxmox_vmstore3: File exists at /usr/share/perl5/PVE/Storage/Plugin.pm line 845.
Apr  7 11:23:11 pve-01 pvestatd[1948]: unable to activate storage 'nfs_proxmox_vmstore3' - directory '/mnt/pve/nfs_proxmox_vmstore3' does not exist

This works:

#v4
/srv/nfs/ X/24(rw,fsid=0,sync,subtree_check,root_squash,crossmnt,sec=krb5)
/srv/nfs/export2/ X/24(rw,fsid=1,sync,subtree_check,no_root_squash,crossmnt,sec=krb5:sys)
/srv/nfs/export3/ X/24(rw,fsid=2,sync,subtree_check,no_root_squash,crossmnt,sec=krb5:sys)
/srv/nfs/export3/datastore3 X/24(rw,fsid=2,sync,subtree_check,root_squash,crossmnt,sec=krb5)

exporting X/24:/srv/nfs/export3/datastore3
exporting X/24:/srv/nfs/export3
exporting X/24:/srv/nfs/export2
exporting X/24:/srv/nfs

But this doesn't work:

/srv/nfs X/24(rw,fsid=0,sync,subtree_check,root_squash,crossmnt,sec=krb5)
/srv/nfs/export2/ X/24(rw,fsid=1,sync,subtree_check,no_root_squash,crossmnt,sec=krb5:sys)
/srv/nfs/export3/ 192.168.120.0/24(rw,fsid=2,sync,subtree_check,no_root_squash,crossmnt,sec=krb5:sys)
/srv/nfs/export3/datastore3 X/24(rw,fsid=2,sync,subtree_check,root_squash,crossmnt,sec=krb5)  Y/24(rw,fsid=2,sync,subtree_check,root_squash,crossmnt,sec=sys) 

exporting Y/24:/srv/nfs/export3/datastore3
exporting X/24:/srv/nfs/export3/datastore3
exporting X/24:/srv/nfs/export3
exporting X/24:/srv/nfs/export2
exporting X/24:/srv/nfs

Spoiler: Storage Configuration

nfs: nfs_proxmox_vmstore2
export /export2/proxmox_vmstore2
path /mnt/pve/nfs_proxmox_vmstore2
server X
nodes pve-01
maxfiles 0
content images
options vers=4.0,minorversion=2,rw,relatime,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,port=0,timeo=14,retrans=2,sec=sys,local_lock=none

nfs: nfs_proxmox_vmstore3
export /export3/proxmox_vmstore3
path /mnt/pve/nfs_proxmox_vmstore3
server X
nodes pve-01
maxfiles 0
content images,iso,backup
options vers=4.0,minorversion=2,rw,relatime,rsize=131072,wsize=131072,namlen=255,hard,proto=tcp,port=0,timeo=14,retrans=2,sec=sys,local_lock=none

Spoiler: PVE Version

proxmox-ve: 4.4-86 (running kernel: 4.4.49-1-pve)
pve-manager: 4.4-13 (running version: 4.4-13/7ea56165)
pve-kernel-4.4.35-1-pve: 4.4.35-77
pve-kernel-4.4.44-1-pve: 4.4.44-84
pve-kernel-4.4.49-1-pve: 4.4.49-86
pve-kernel-4.4.40-1-pve: 4.4.40-82
lvm2: 2.02.116-pve3
corosync-pve: 2.4.2-2~pve4+1
libqb0: 1.0.1-1
pve-cluster: 4.0-49
qemu-server: 4.0-110
pve-firmware: 1.1-11
libpve-common-perl: 4.0-94
libpve-access-control: 4.0-23
libpve-storage-perl: 4.0-76
pve-libspice-server1: 0.12.8-2
vncterm: 1.3-2
pve-docs: 4.4-4
pve-qemu-kvm: 2.7.1-4
pve-container: 1.0-97
pve-firewall: 2.0-33
pve-ha-manager: 1.0-40
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u3
lxc-pve: 2.0.7-4
lxcfs: 2.0.6-pve1
criu: 1.6.0-1
novnc-pve: 0.5-9
smartmontools: 6.5+svn4324-1~pve80
zfsutils: 0.6.5.9-pve15~bpo80
openvswitch-switch: 2.6.0-2

NFS server is Debian 9. If I use showmount -e nfs_server_ip (via nfs3) on proxmox node, i still see those exports. Where is the problem?

 

[dcsapak]

Apr 7 11:23:00 pve-01 pvestatd[1948]: mkdir /mnt/pve/nfs_proxmox_vmstore3: File exists at /usr/share/perl5/PVE/Storage/Plugin.pm line 845. Apr 7 11:23:11 pve-01 pvestatd[1948]: unable to activate storage 'nfs_proxmox_vmstore3' - directory '/mnt/pve/nfs_proxmox_vmstore3' does not exist

is there a file which sits there? it seems we cannot create the directories and thus cannot mount it?

 

[czechsys]

This is when nfs unmounted:

root@pve-02:/mnt/pve# ls -al
drwxr-xr-x 2 root root 4096 Mar 23 09:53 nfs_proxmox_vmstore2
drwxr-xr-x 2 root root 4096 Mar 23 09:53 nfs_proxmox_vmstore3

root@pve-02:/mnt/pve# cd nfs_proxmox_vmstore2
root@pve-02:/mnt/pve/nfs_proxmox_vmstore2# ls -al
total 8
drwxr-xr-x 2 root root 4096 Mar 23 09:53 .
drwxr-xr-x 4 root root 4096 Mar 23 09:53 ..

root@pve-02:/mnt/pve# cd nfs_proxmox_vmstore3/                                                                                                root@pve-02:/mnt/pve/nfs_proxmox_vmstore3# ls -al
total 8
drwxr-xr-x 2 root root 4096 Mar 23 09:53 .
drwxr-xr-x 4 root root 4096 Mar 23 09:53 ..

If i understand, with "bad /etc/export" proxmox can't get access to nfs4 share? That's why it cant "write/activate"? If yes, it's expected from me (nobody want to write to localdir which is mountpoint for network share). I will rather having hypervisor doing its job with network storage than mounting it via fstab and mounted to proxmox via dir. But "/etc/export" looks ok via documentation.

This is when nfs mounted:

root@pve-02:/mnt/pve/nfs_proxmox_vmstore2# ls -al
total 12
drwxr-xr-x 3 root root 4096 Feb 17 15:59 .
drwxr-xr-x 4 root root 4096 Mar 23 09:53 ..
drwxr-xr-x 3 root root 4096 Feb 17 16:00 images

If you need more info, please specify more, your question was not enough to understand.