ceph full-mesh

  1. W

    FRR OpenFabric creating a loop (?) in full mesh Ceph setup after reconnecting the interface

    Hello, I have 4 Proxmox nodes with 2x10G interfaces. I am testing out a configuration without a switch. I have followed the tutorial in the https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server The only difference between my setup and the setup in the tutorial is the addition of the...
  2. C

    Mesh Ceph Network with FRR Openfabric - Route question

    Looks like my route setup wants to route over one of the hosts to get to another, even though i have all 3 100G dac cables, attached, it wont direct connect to the other host for some reason? pve1 => .1 pve2 => .2 pve3 => .3 pve1 port1 -> pve2 port 1 pve1 port 2 -> pve3 port 1 pve3 port2 ->...
  3. G

    [SOLVED] Three-nodes Ceph mesh network with bond and VLANs

    Hi everyone, I'm designing a new 3-node cluster. It's not the first cluster I make but it's the first with a full-mesh Ceph network (no dedicated switch) . Each node has a double 10G NIC and they're already physically connected each other. So I've been reading the docs and I think the best...
  4. B

    First Proxmox HA cluster with 3 nodes and 2 ceph pools

    Hi, In the company we have decided to migrate our applications from a public cloud provider to our own solution based on proxmox ha cluster. Since this is the first such installation I have a great request for an opinion on the approach we have chosen for this. General assumptions: - 3...
  5. L

    Mellanox ConnectX-6 Dx - full mesh - slow into VM

    Hi there I have 3 Proxmox nodes Supermicro SYS-120C-TN10R connected via Mellanox 100GbE ConnectX-6 Dx cards in cross-connect mode using MCP1600-C00AE30N DAC Cable Ethernet 100GbE QSFP28 0.5m # lspci -vv -s 98:00.0 98:00.0 Ethernet controller: Mellanox Technologies MT2892 Family [ConnectX-6...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!