jdancer's latest activity

  • J
    Since Proxmox is Debian with an Ubuntu LTS kernel, it's reliable enough. Have it running on a Dell Latitude 5421 with no issues.
  • J
    jdancer replied to the thread Ceph in 2026 HDD.
    Been migrating Dell VMware clusters running SAS HDDs over to Proxmox Ceph. As you know, Ceph is a scale-out solution. More nodes/OSDs = more IOPS. These Dells are 2U 16-drive bay servers. Use 2 small SAS drives to mirror Proxmox using ZFS...
  • J
    jdancer replied to the thread 4 node cluster with CEPH.
    Been migrating Dell VMware clusters over to Proxmox Ceph clusters. As with VMware, Ceph really, really wants homogeneous hardware, ie, same CPU, memory, storage, storage controller, firmware, networking. While it's true, 3-nodes is the minimum...
  • J
    If you know you will never expand this 3-node cluster, I suggest using a full-mesh broadcast network. This eliminates a switch and every node will drop packets not addressed to it. Promox has a KB on it at...
  • J
    At work, been migrating 13th & 14th-gen Dell VMware clusters over to Proxmox Ceph. Swap out the PERC RAID controllers for Dell HBA330s IT-mode controllers, since Ceph/ZFS don't work with RAID controllers. If I was buying new, I will go with...
  • J
    jdancer replied to the thread CEPH & ZFS Using a PERC H755n.
    As you know, ZFS & Ceph really don't play nice with RAID controllers like Dell PERCs. While it's true you change the PERC from RAID mode to IT-mode, I've had issues in the past with the megaraid_sas driver. That's why I switch out Dell PERCs for...
  • J
    On 13th- & 14th-gen Dells PERCs, have to delete the virtual disks before switching it to HBA-mode. Call it a quirk. I've also had issues with the megaraid_sas driver in the past, so I just swap out the PERCs for Dell HBA330s, which is a true...
  • J
    Have it running on a Dell R200 which was released back in 2007. Was running LXCs but now it's a PBS instance. Mirrored ZFS drives. Makes for good small LXC/PBS server but that's all it's good for.
  • J
    jdancer reacted to aaron's post in the thread Ceph low performance with Like Like.
    Those are on the cheaper and slower side of consumer SSDs. They will not perform well with sustained load and the primarily sync writes that Ceph does. The recommendation for enterprise SSDs with power loss protection (PLP) is there for good...
  • J
    I don't run nested virtualization using Windows guests but do with Linux guests especially with Proxmox, ie, phystical Proxmox -> vitual Proxmox -> Linux guest. I do use CPU type of 'host' as your screenshot shows. As for number of cores, I see...
  • J
    For 13th-gen Dells, enabling X2APIC & IOAT DMA resolves the issue. I don't use SRV-IO.
  • J
    I run Proxmox on 10th through 14th-generation Dells at work. Yup, this is with latest Proxmox 9.1.x with latest 7.0.x kernel. No issues. I just made sure the machines has the latest firmware and BIOS/UEFI. I do NOT use any RAID controllers...
  • J
    You are better off flashing the 12th-gen PERCs to IT-mode via https://fohdeesha.com/docs/perc.html Do NOT skip any steps and record the SAS address. No issues in production.
  • J
    Dell HBA330 mini-mono versions are definately for 13th- and 14th-gen Dells. For 12th-gen Dell PERCs (H310/H710/H710P/H810), use https://fohdeesha.com/docs/perc.html. No issues in production. Do NOT skip any steps and take your time. If you want...
  • J
    Been testing EC pools with plugin=ISA technique=reed_sol_van with VMs with additional storage optimizations. Weirdly enought, it's faster in read operations than replication. Not complaining.
  • J
    This. Look for PLP. I will also look for high endurance. I use Intel DC-S3710s for their 10 DWPD endurance.
  • J
    I've been migrating from VMware vSphere to Proxmox Ceph at work on 13th-gen Dells. Ceph really, really, really wants homogeneous hardware, ie, same CPU, RAM, NIC, storage, storage controller, firmware, etc, etc. I swapped out PERCs for Dell...