Glusterfs fuse slow, how you handle data access in vm?

czechsys

Renowned Member
Nov 18, 2015
419
43
93
Hello,
I tested glusterfs 3.8.5 on 4.3 proxmox. Storages are dedicated fast supermicros with intel 3510 ssds, proxmox is hp g6 server. Fio performance inside vm through libgfapi is good. But if i connect storage inside vm through fuse, i am getting only 10% fuse performance of the libgfapi in random rw mode (tests are 75/25 read/write). Its almost unusable for sharing data between www servers.
Any idea or how do you handle this?

Thanks.
 
Have you tried NFS mounting your GlusterFS volume? Instead of FUSE?
 
Good point. I tested fio read/write and results are better. Too bad, nfs-kernel-server crash on randrw tests...Problem is, can't use in-built nfs because there is drbd array exported via nfs-kernel-server...
 
NFS-Ganesha is problematic now, because we are fully Debian and there are missing packages/dependencies for that, even when source is glusterfs download repozitory.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!