mount nfs export /

[p0nts]

Dear all,

I am running a hdfs/hadoop cluster with a nfs gateway which is perfectly mountable through the OS by using the following settings in fstab:

10.0.16.2:/ /hdfs nfs rw,vers=3,proto=tcp,nolock,timeo=600 0 0

Tho as soon as I want to add this to proxmox proxmox does not allow me to do this due to / being the export, while the only export available is / so it is the only possible path I can provide.

nfs: hadoop
export /
path /mnt/pve/hadoop
server 10.0.16.2
content images
options vers=3

Gives the following error:

export: Invalid format - value does not look like a valid absolute path

So, what can I do to mount hdfs (over nfs) to proxmox?

I've also tried to add a directory storage after mounting the nfs filesystem through the OS, unfortuantly during installation the debian install is unable to find the proper drivers to install a disk and therefore I would like to mount nfs directly to see if that makes any difference.

 

[wolfgang]

Hi,

we have a parser the ensure that we get valid values.
In this case we assume that you have a export name and not start with root.
To solve this you have to give the export a name.

 

[p0nts]

Thank you for your answer

Unfortunatly that is not possible as far as I know with hadoop/hdfs, is there anything else I can try?

 

[wolfgang]

I would use it as normal directory storage with shared option 1 and mount it on the nodes with fstab.
The benefit use different clients for this.

 

[p0nts]

Yes that is exactly what I've tried to do but unfortunately something is going wrong because the disk image on the nfs mount will be 192kb big instead of 32GB and during installation it is looking for harddisk drivers.

Might have something to do with the permissions.

 

[wolfgang]

Have you tried the hdfs client?

 

[p0nts]

Is there a hdfs client for proxmox?

 

[wolfgang]

We have not a official client but you have the freedom to install a client or the hole server suite ;-)

I never test this client and don't know if it work.
https://github.com/balazsbotond/hadoop-client-deb-package

 

[p0nts]

I've checked but this can't work because you wont be able to mount the actual drive or something simular.

It allows you to store/retrieve through scripts which is not really supported by proxmox.

 

[Alwin]

Qemu can write to fuse mounts.
https://wiki.apache.org/hadoop/MountableHDFS