ceph full-mesh

  1. K

    Ceph Migration bond (LACP) Interfaces zu Openfabric

    Hallo, ich möchte meinen 3 Nodes Cluster mit je 2 x 25Gb ( bond0 LACP) von Switch auf Full Mesh über direkte Verbindung umstellen. Da ich keine NICs mehr frei habe, ist es von meinem Verständnis her nicht so ganz einfach... ...oder doch nicht? Deswegen meine Frage: Ist es möglich ein Openfabric...
  2. EllerholdAG

    Upgrade von manual FRR full-mesh to fabrics in PVE 9

    Hello lovely people, I just found out, that the full mesh setup for Ceph is now possibly in the PVE 9 GUI (Datacenter -> SDN -> Fabrics). Can I upgrade from the old manual version to this new version somehow gracefully or do I have to shutdown everything and migrate?
  3. W

    FRR OpenFabric creating a loop (?) in full mesh Ceph setup after reconnecting the interface

    Hello, I have 4 Proxmox nodes with 2x10G interfaces. I am testing out a configuration without a switch. I have followed the tutorial in the https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server The only difference between my setup and the setup in the tutorial is the addition of the...
  4. C

    Mesh Ceph Network with FRR Openfabric - Route question

    Looks like my route setup wants to route over one of the hosts to get to another, even though i have all 3 100G dac cables, attached, it wont direct connect to the other host for some reason? pve1 => .1 pve2 => .2 pve3 => .3 pve1 port1 -> pve2 port 1 pve1 port 2 -> pve3 port 1 pve3 port2 ->...
  5. G

    [SOLVED] Three-nodes Ceph mesh network with bond and VLANs

    Hi everyone, I'm designing a new 3-node cluster. It's not the first cluster I make but it's the first with a full-mesh Ceph network (no dedicated switch) . Each node has a double 10G NIC and they're already physically connected each other. So I've been reading the docs and I think the best...
  6. B

    First Proxmox HA cluster with 3 nodes and 2 ceph pools

    Hi, In the company we have decided to migrate our applications from a public cloud provider to our own solution based on proxmox ha cluster. Since this is the first such installation I have a great request for an opinion on the approach we have chosen for this. General assumptions: - 3...
  7. L

    Mellanox ConnectX-6 Dx - full mesh - slow into VM

    Hi there I have 3 Proxmox nodes Supermicro SYS-120C-TN10R connected via Mellanox 100GbE ConnectX-6 Dx cards in cross-connect mode using MCP1600-C00AE30N DAC Cable Ethernet 100GbE QSFP28 0.5m # lspci -vv -s 98:00.0 98:00.0 Ethernet controller: Mellanox Technologies MT2892 Family [ConnectX-6...