Hello community,
I'd like to ask for an advice from ones you own minisforum ms-01 and running proxmox on it. I have ordered 3 of them but as much as I am reading about experience of other users i have now concerns. Is it really so bad in terms of stability? I know as a first thing is to fix Intel remote access, bios and microcode. After this, is box still not stable? Can you let me know if CEPH over thunderbolt4 ports is worth of effort? I am thinking about these possible setups and still cant decide Each setup will be same on all 3 nodes if i decide for right one, so:
Setup1, combination ceph and zfs-pool for HA:
network part:
TH4 ports- CEPH public and internal net
10g - VMs
10g - Proxmox
2.5g - corosync
2.5g - Intel vPro - OOB management
drives:
PCIe4x4 - 1 TB - for CEPH osd
PCIE3x4 - 2 TB - zfs-pool
PCIE3x2 - OS Proxmox
Setup2, ceph and zfs-pool for HA:
network part:
TH4 ports- not used
2x10g - Lacp for CEPH
2x10g - pcie card - proxmox and VMs
2.5g - corosync
2.5g - Intel vPro - OOB management
drives:
PCIe4x4 - 1 TB - CEPH
PCIE3x4 - 2 TB - zfs-pool
PCIE3x2 - OS Proxmox
Setup3, zfs-pool only for HA:
network part:
TH4 ports- not used
10g - VMs
10g - Proxmox
2.5g - corosync
2.5g - Intel vPro - OOB management
drives:
PCIe4x4 - 2 TB - zfs-pool
PCIE3x4 -
PCIE3x2 - OS Proxmox
I am considering CEPH setup, but as I read experience of other guys, not sure if it really benefits so much over ZFS-POOL, mostly when i read of so many issues keep ceph stable and working during reboots etc... I'd like to setup cluster and HA and run/use it most of the time not troubleshoot.
Thank you so much.
I'd like to ask for an advice from ones you own minisforum ms-01 and running proxmox on it. I have ordered 3 of them but as much as I am reading about experience of other users i have now concerns. Is it really so bad in terms of stability? I know as a first thing is to fix Intel remote access, bios and microcode. After this, is box still not stable? Can you let me know if CEPH over thunderbolt4 ports is worth of effort? I am thinking about these possible setups and still cant decide Each setup will be same on all 3 nodes if i decide for right one, so:
Setup1, combination ceph and zfs-pool for HA:
network part:
TH4 ports- CEPH public and internal net
10g - VMs
10g - Proxmox
2.5g - corosync
2.5g - Intel vPro - OOB management
drives:
PCIe4x4 - 1 TB - for CEPH osd
PCIE3x4 - 2 TB - zfs-pool
PCIE3x2 - OS Proxmox
Setup2, ceph and zfs-pool for HA:
network part:
TH4 ports- not used
2x10g - Lacp for CEPH
2x10g - pcie card - proxmox and VMs
2.5g - corosync
2.5g - Intel vPro - OOB management
drives:
PCIe4x4 - 1 TB - CEPH
PCIE3x4 - 2 TB - zfs-pool
PCIE3x2 - OS Proxmox
Setup3, zfs-pool only for HA:
network part:
TH4 ports- not used
10g - VMs
10g - Proxmox
2.5g - corosync
2.5g - Intel vPro - OOB management
drives:
PCIe4x4 - 2 TB - zfs-pool
PCIE3x4 -
PCIE3x2 - OS Proxmox
I am considering CEPH setup, but as I read experience of other guys, not sure if it really benefits so much over ZFS-POOL, mostly when i read of so many issues keep ceph stable and working during reboots etc... I'd like to setup cluster and HA and run/use it most of the time not troubleshoot.
Thank you so much.