jdancer's latest activity

  • J
    jdancer replied to the thread CEPH Performance.
    As they say, it depends on workloads. Ceph is a scale-out solution, more nodes/OSDs = more IOPS. At least you got the right number of nodes and networking correct at the beginning. Been using Ceph Tentacle erasure-coding for some VMs workloads...
  • J
    I have flashed a PERC 6 in a Dell R200 to IT-mode using Broadcom firmware using someone's web blog post. This was awhile ago. 12th-gen Dell PERC controllers (ie, H310) can be flashed to IT-mode per https://fohdeesha.com/docs/perc.html I have...
  • J
    Hardware that works in both R630 & R640, you can use the R640 firmware for the hardware on the R630. I flashed the firmware using the Dell .BIN file for RHEL & clones.
  • J
    I use Dell X550/I350 rNDCs (CD2VM) wihout issues in production with the latest 7.x kernel in R630s. BIOS settings enabled options are X2APIC, I/OAT DMA, UEFI, and Secure Boot. I do NOT have SR-IOV enabled. I did flash the Dell version 23.0.0...
  • J
    Since Proxmox is Debian with an Ubuntu LTS kernel, it's reliable enough. Have it running on a Dell Latitude 5421 with no issues.
  • J
    jdancer replied to the thread Ceph in 2026 HDD.
    Been migrating Dell VMware clusters running SAS HDDs over to Proxmox Ceph. As you know, Ceph is a scale-out solution. More nodes/OSDs = more IOPS. These Dells are 2U 16-drive bay servers. Use 2 small SAS drives to mirror Proxmox using ZFS...
  • J
    jdancer replied to the thread 4 node cluster with CEPH.
    Been migrating Dell VMware clusters over to Proxmox Ceph clusters. As with VMware, Ceph really, really wants homogeneous hardware, ie, same CPU, memory, storage, storage controller, firmware, networking. While it's true, 3-nodes is the minimum...
  • J
    If you know you will never expand this 3-node cluster, I suggest using a full-mesh broadcast network. This eliminates a switch and every node will drop packets not addressed to it. Promox has a KB on it at...
  • J
    At work, been migrating 13th & 14th-gen Dell VMware clusters over to Proxmox Ceph. Swap out the PERC RAID controllers for Dell HBA330s IT-mode controllers, since Ceph/ZFS don't work with RAID controllers. If I was buying new, I will go with...
  • J
    jdancer replied to the thread CEPH & ZFS Using a PERC H755n.
    As you know, ZFS & Ceph really don't play nice with RAID controllers like Dell PERCs. While it's true you change the PERC from RAID mode to IT-mode, I've had issues in the past with the megaraid_sas driver. That's why I switch out Dell PERCs for...
  • J
    On 13th- & 14th-gen Dells PERCs, have to delete the virtual disks before switching it to HBA-mode. Call it a quirk. I've also had issues with the megaraid_sas driver in the past, so I just swap out the PERCs for Dell HBA330s, which is a true...
  • J
    Have it running on a Dell R200 which was released back in 2007. Was running LXCs but now it's a PBS instance. Mirrored ZFS drives. Makes for good small LXC/PBS server but that's all it's good for.