2 Proxmox nodes with glusterfs (hyperconvergence)

[pizza]

Is it possible to setup 2 Proxmox nodes with glusterfs server on the same nodes and mount storage with the glusterfs plugin?

Ovirt has it already: http://blogs-ramesh.blogspot.nl/201...perconvergence.html?showComment=1454412067118

 

[alexskysilk]

yes, although I dont think gluster is built into the proxmox distro (mods- is this true?)

you'll just need to install the gluster stack and configure it per https://gluster.readthedocs.org/en/latest/Quick-Start-Guide/Quickstart/

you can then provision the volume(s) from the GUI or CLI. In either case (ovirt or proxmox) you need to be aware of the network traffic implications of doing this- make sure you have a separate, dedicated, fast network for storage cluster traffic or you'll not enjoy the results.

 

[pizza]

I'm testing it. glusterfs-server package must manually installed. KVM works, LXC is not supported yet?

 

[dietmar]

LXC is not supported yet?

No, LXC does not work with gluster currently.

 

[stephane_c]

Hello,
I have installed a glusterFS server on the Proxmox host, and gluster-client on all my nodes (LXC too).
I think if we can install a gluster-client on LXC, we can install the server too.
But you need to follow 2/3 modifications:
On the LXC, before boot gluster, you need to enter command :
"mknod /dev/fuse c 10 229"
(You can do-it on the /etc/rc.local file) and restart gluster after.

I don't test with glusterFS server, but it's work with the client.

Regards,
Stephane

 

[fabian]

Hello,
I have installed a glusterFS server on the Proxmox host, and gluster-client on all my nodes (LXC too).
I think if we can install a gluster-client on LXC, we can install the server too.
But you need to follow 2/3 modifications:
On the LXC, before boot gluster, you need to enter command :
"mknod /dev/fuse c 10 229"
(You can do-it on the /etc/rc.local file) and restart gluster after.

I don't test with glusterFS server, but it's work with the client.

Regards,
Stephane

That's a very bad idea, because FUSE is not compatible with the kernel's freezer mechanism. If you mount a FUSE fs inside the container lxc-freeze (which is used by both the snapshot and the suspend mode backups) will probably fail.

 

[stephane_c]

Thank for your advice, I didn't know.
I don't have problem because I don't use the freeze mechanism, but I will try to find a better solution.