jdancer's latest activity

  • J
    I've been migrating from VMware vSphere to Proxmox Ceph at work on 13th-gen Dells. Ceph really, really, really wants homogeneous hardware, ie, same CPU, RAM, NIC, storage, storage controller, firmware, etc, etc. I swapped out PERCs for Dell...
  • J
    Seeing that the MD3200i is a legacy SAN, maybe cheaper to migrate to Ceph. Been migrating VMware legacy SAN infrastructure to Proxmox Ceph. IMO, need a minimum of 5-nodes. So, can lose 2 nodes and still have quorum. Isolated switches for Corosync...
  • J
    A better option, IMO, is to use a pure IT-mode storage controller like a Dell HBA330. Extremely cheap to get. Uses the much simpler mtp3sas driver and don't have to deal with PERC storage drama. No issues in production.
  • J
    Been migrating 13th-gen Dells (R630s & R730s) from VMware to Proxmox Ceph. Clusters range from 3- to 9-nodes, all odd number for quorum. All hardware is the same (RAM, CPU, NIC, storage, storage controller, firmware). Swapped out PERCs for Dell...
  • J
    jdancer replied to the thread Cluster best practices.
    Considered best practice that cluster traffic have it's own network/vlan. I just create a additional vmbr (ie, vmbr1 or whatever number you want [best to use a VLAN number, if used]) and when I create the cluster, make sure it uses that network...
  • J
    Most large organizations treat Proxmox VE in terms of accrediation/ATO as an appliance. Since PVE is a hypervisor platform. It's NOT meant to directly run workloads. Workloads are done via VMs/LXCs. Same with PBS & PDM. It's treated as an...
  • J
    A better option is to avoid the PERC HBA-mode drama and get a Dell HBA330. It's a true IT-mode storage controller based on the LSI3008 chip. Real cheap to get. Just make sure to remove any existing virtual disks prior to use and flash to latest...
  • J
    Currently using a full-mesh 3-node Proxmox Ceph cluster using Resource Pools. Created individual accounts and have them log in using the Proxmox VE authentication realm. Each VE account has PVEAdmin permissions to the Ceph pools and Networking...
  • J
    Use consumer SSDs at your peril. They fail and fail spectacularly. Only real solution is enterprise SSDs with PLP (power-loss protection) and for endurance.
  • J
    This. Since I follow the KISS principle, I use active/passive setup. I believe even VMware recommends this before I migrated to Proxmox.
  • J
    Don't know if matters but latest firmware for Dell HBA330 is 16.17.01.00 A08. May or may not help your issue. No issues on 16-drive bay R730s in production.
  • J
    jdancer replied to the thread Dell R610’s good for PBS.
    I use a Dell R200 to backup a Dell R320. Dell R200 has PERC flashed to IT-mode with 2 x 4TB SAS drives using ZFS RAID-1 with 8GB of RAM. No issues.
  • J
    Prior to migrating, may need to regenerate the kernel to include all the drivers. Had to do this when migrating to Hyper-V. So, run the following as root: dracut -fv -N --regenerate-all
  • J
    Yes, the no-sub repos are fine as long as you have Linux SME skills. Always have a Plan B which is backups. I highly recommend you test updates on a separate server/cluster before pushing to production.
  • J
    jdancer replied to the thread 10G NIC HCL for Proxmox 9.0.3.
    I haven't migrated to PVE 9 yet. I'm still on PVE 8 at home. I wonder if a ConnectX-4 LX works?
  • J
    Ditch the PERC HBA-mode drama and swap it for a Dell HBA330 true IT/HBA-mode storage controller. Your future self will thank you. Plus, HBA330s are very cheap to get. Update to latest firmware from dell.com/support
  • J
    Just as Proxmox Backup Server supports namespaces to do hierarchical backups on the same backup pool, does Proxmox VE support namespaces for the creation of VMs/CTs as well on the same node/cluster? I really, really do NOT want to stand up an...
  • J
    Hopefully you have backups. I strongly recommend using a pure IT/HBA-mode storage controller. Use software-defined storage (ZFS, LVM, Ceph) to handle your storage needs. I use a LSI3008 IT-mode storage controller (Dell HBA330) in production...
  • J
    Seriously, ditch the PERC HBA-mode drama and get a Dell HBA330 which is a true IT/HBA-mode controller. Uses the much simpler mpt3sas driver. Be sure to update to latest firmware at dell.com/support Super cheap to get and no more drama! LOL!
  • J
    While it's true that 3-nodes is the bare minimum for Ceph, losing a node and depending on the other 2 to pick up the slack workload will make me nervous. For best practices, start with 5-nodes. With Ceph, more nodes/OSDs = more IOPS. As been...