Proxmox 3 node setup on minisforum ms-01, zfs replication vs ceph

JanoStasik

New Member
Sep 23, 2024
2
0
1
Hello community,
I'd like to ask for an advice from ones you own minisforum ms-01 and running proxmox on it. I have ordered 3 of them but as much as I am reading about experience of other users i have now concerns. Is it really so bad in terms of stability? I know as a first thing is to fix Intel remote access, bios and microcode. After this, is box still not stable? Can you let me know if CEPH over thunderbolt4 ports is worth of effort? I am thinking about these possible setups and still cant decide :) Each setup will be same on all 3 nodes if i decide for right one, so:

Setup1, combination ceph and zfs-pool for HA:
network part:
TH4 ports- CEPH public and internal net
10g - VMs
10g - Proxmox
2.5g - corosync
2.5g - Intel vPro - OOB management
drives:
PCIe4x4 - 1 TB - for CEPH osd
PCIE3x4 - 2 TB - zfs-pool
PCIE3x2 - OS Proxmox

Setup2, ceph and zfs-pool for HA:
network part:
TH4 ports- not used
2x10g - Lacp for CEPH
2x10g - pcie card - proxmox and VMs
2.5g - corosync
2.5g - Intel vPro - OOB management
drives:
PCIe4x4 - 1 TB - CEPH
PCIE3x4 - 2 TB - zfs-pool
PCIE3x2 - OS Proxmox

Setup3, zfs-pool only for HA:
network part:
TH4 ports- not used
10g - VMs
10g - Proxmox
2.5g - corosync
2.5g - Intel vPro - OOB management
drives:
PCIe4x4 - 2 TB - zfs-pool
PCIE3x4 -
PCIE3x2 - OS Proxmox

I am considering CEPH setup, but as I read experience of other guys, not sure if it really benefits so much over ZFS-POOL, mostly when i read of so many issues keep ceph stable and working during reboots etc... I'd like to setup cluster and HA and run/use it most of the time not troubleshoot.

Thank you so much.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!