ceph full-mesh

  1. W

    FRR OpenFabric creating a loop (?) in full mesh Ceph setup after reconnecting the interface

    Hello, I have 4 Proxmox nodes with 2x10G interfaces. I am testing out a configuration without a switch. I have followed the tutorial in the https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server The only difference between my setup and the setup in the tutorial is the addition of the...
  2. C

    Mesh Ceph Network with FRR Openfabric - Route question

    Looks like my route setup wants to route over one of the hosts to get to another, even though i have all 3 100G dac cables, attached, it wont direct connect to the other host for some reason? pve1 => .1 pve2 => .2 pve3 => .3 pve1 port1 -> pve2 port 1 pve1 port 2 -> pve3 port 1 pve3 port2 ->...
  3. G

    [SOLVED] Three-nodes Ceph mesh network with bond and VLANs

    Hi everyone, I'm designing a new 3-node cluster. It's not the first cluster I make but it's the first with a full-mesh Ceph network (no dedicated switch) . Each node has a double 10G NIC and they're already physically connected each other. So I've been reading the docs and I think the best...
  4. B

    First Proxmox HA cluster with 3 nodes and 2 ceph pools

    Hi, In the company we have decided to migrate our applications from a public cloud provider to our own solution based on proxmox ha cluster. Since this is the first such installation I have a great request for an opinion on the approach we have chosen for this. General assumptions: - 3...
  5. L

    Mellanox ConnectX-6 Dx - full mesh - slow into VM

    Hi there I have 3 Proxmox nodes Supermicro SYS-120C-TN10R connected via Mellanox 100GbE ConnectX-6 Dx cards in cross-connect mode using MCP1600-C00AE30N DAC Cable Ethernet 100GbE QSFP28 0.5m # lspci -vv -s 98:00.0 98:00.0 Ethernet controller: Mellanox Technologies MT2892 Family [ConnectX-6...