Native MooseFS client support on ProxMox

[plofkat]

Would something like this be possible?

I have been using MooseFS as my shared storage with ProxMox for about 5 years, and it has proven to be rock solid and reliable.

Getting it to work with Proxmox is trivial - add moosefs repo, install moosefs-client and add entry to /etc/fstab to mount it in set directory (/mnt/mfs) on each proxmox server.

It would be nice to see some stats for moosefs on the console, (chunk server and disk health, etc) as well as support for the moosefs snapshot feature.

 

[Alessandro 123]

Interesting. Support to multiple storages is always a good thing.

 

[Roland Niebuhr]

Hi,
I'm interested in a native moosefs client too.
Any progress on this?

 

[plofkat]

I do not think they are planning on adding MFS support. It's a shame, because it works beautifully with ProxMox.
I would recommend having the storage and corosync networks on separate physical adapters and switches for better performance.

 

[Alwin]

I do not think they are planning on adding MFS support. It's a shame, because it works beautifully with ProxMox.

No plans. But there is always the possibility two write your own custom storage plugin. See the links below.
https://pve.proxmox.com/pipermail/pve-devel/2016-August/022533.html
https://pve.proxmox.com/wiki/Developer_Documentation

I would recommend having the storage and corosync networks on separate physical adapters and switches for better performance.

This is always a recommended step.

 

[zorlin]

Bumping an old thread (sorry) to say that I've developed a VERY rough and early plugin for just this purpose.

https://github.com/Zorlin/pve-moosefs

 

[UdoB]

I've developed a VERY rough and early plugin

Did you do some (fio-) benchmarks? Being a fuse-based system my personal expectations would be very low, compared to - let's say - non-redundant/classic NFS.

Best regards

 

[zorlin]

Did you do some (fio-) benchmarks? Being a fuse-based system my personal expectations would be very low, compared to - let's say - non-redundant/classic NFS.

Best regards

Not yet, still working out some stability things and generally kicking the tires. In theory MooseFS should be on par with or outperform NFS on decent hardware. While it is FUSE-based, I've found it can be quite performant depending on your workload.

This plugin is pretty early days, though; it has a few bugs that I'm going to work through with the Proxmox devs hopefully

 

[liberodark]

Hi,

Have work on moosefs and yes i think this would be great to add support on proxmox.
Performance is very good. Thank @zorlin for your work probably this need to be rewrite for send a PR to PVE.

Best Regards

 

[zorlin]

Hello folks! I've cleaned up my plugin and it's now mostly ready for consumption.

Check it out here - https://github.com/Zorlin/pve-moosefs



Please open an issue on https://github.com/Zorlin/pve-moosefs if you have any issues.

 

[zorlin]

Did you do some (fio-) benchmarks? Being a fuse-based system my personal expectations would be very low, compared to - let's say - non-redundant/classic NFS.

Best regards

I've released a near-production-ready version of pve-moosefs now that adds support for MooseFS Block Device (mfsbdev). This allows for high performance VMs that bypass FUSE and qcow2 entirely, suitable for database workloads.

https://github.com/Zorlin/pve-moosefs/releases/tag/v0.1.3