Been migrating Dell VMware clusters running SAS HDDs over to Proxmox Ceph.
As you know, Ceph is a scale-out solution. More nodes/OSDs = more IOPS. These Dells are 2U 16-drive bay servers. Use 2 small SAS drives to mirror Proxmox using ZFS...
Been migrating Dell VMware clusters over to Proxmox Ceph clusters.
As with VMware, Ceph really, really wants homogeneous hardware, ie, same CPU, memory, storage, storage controller, firmware, networking.
While it's true, 3-nodes is the minimum...
If you know you will never expand this 3-node cluster, I suggest using a full-mesh broadcast network. This eliminates a switch and every node will drop packets not addressed to it. Promox has a KB on it at...
At work, been migrating 13th & 14th-gen Dell VMware clusters over to Proxmox Ceph. Swap out the PERC RAID controllers for Dell HBA330s IT-mode controllers, since Ceph/ZFS don't work with RAID controllers.
If I was buying new, I will go with...
As you know, ZFS & Ceph really don't play nice with RAID controllers like Dell PERCs.
While it's true you change the PERC from RAID mode to IT-mode, I've had issues in the past with the megaraid_sas driver. That's why I switch out Dell PERCs for...
On 13th- & 14th-gen Dells PERCs, have to delete the virtual disks before switching it to HBA-mode. Call it a quirk.
I've also had issues with the megaraid_sas driver in the past, so I just swap out the PERCs for Dell HBA330s, which is a true...
Have it running on a Dell R200 which was released back in 2007. Was running LXCs but now it's a PBS instance. Mirrored ZFS drives.
Makes for good small LXC/PBS server but that's all it's good for.
Those are on the cheaper and slower side of consumer SSDs. They will not perform well with sustained load and the primarily sync writes that Ceph does.
The recommendation for enterprise SSDs with power loss protection (PLP) is there for good...
I don't run nested virtualization using Windows guests but do with Linux guests especially with Proxmox, ie, phystical Proxmox -> vitual Proxmox -> Linux guest.
I do use CPU type of 'host' as your screenshot shows. As for number of cores, I see...
I run Proxmox on 10th through 14th-generation Dells at work. Yup, this is with latest Proxmox 9.1.x with latest 7.0.x kernel. No issues.
I just made sure the machines has the latest firmware and BIOS/UEFI.
I do NOT use any RAID controllers...
You are better off flashing the 12th-gen PERCs to IT-mode via https://fohdeesha.com/docs/perc.html
Do NOT skip any steps and record the SAS address.
No issues in production.
Dell HBA330 mini-mono versions are definately for 13th- and 14th-gen Dells.
For 12th-gen Dell PERCs (H310/H710/H710P/H810), use https://fohdeesha.com/docs/perc.html. No issues in production.
Do NOT skip any steps and take your time. If you want...
Been testing EC pools with plugin=ISA technique=reed_sol_van with VMs with additional storage optimizations. Weirdly enought, it's faster in read operations than replication. Not complaining.
I've been migrating from VMware vSphere to Proxmox Ceph at work on 13th-gen Dells.
Ceph really, really, really wants homogeneous hardware, ie, same CPU, RAM, NIC, storage, storage controller, firmware, etc, etc. I swapped out PERCs for Dell...