openfabric

  1. K

    Ceph Migration bond (LACP) Interfaces zu Openfabric

    Hallo, ich möchte meinen 3 Nodes Cluster mit je 2 x 25Gb ( bond0 LACP) von Switch auf Full Mesh über direkte Verbindung umstellen. Da ich keine NICs mehr frei habe, ist es von meinem Verständnis her nicht so ganz einfach... ...oder doch nicht? Deswegen meine Frage: Ist es möglich ein Openfabric...
  2. F

    SDN / Ceph Private Network

    Hello, With the major SDN enhancements introduced in Proxmox 9.0, is it now recommended to use these built-in SDN features to separate Ceph network traffic, rather than relying on traditional VLANs configured through a switch or OPNsense?
  3. B

    PVE Full Mesh reconfiguration - Ceph (got timeout 500)

    Hello everyone, I have a 3-node PVE cluster that I am using for testing and learning on. On this PVE cluster, I recently created a CEPH pool and had 4 VMs residing on it. My PVE cluster was connected to my Mellanox 40GbE switch but I wanted to explore reconfiguring it for full mesh, which I...
  4. C

    [SOLVED] Access fabric full mesh network with local VM

    Hello, We operate multiple 3-node clusters. For the VM LAN, each node has 2× 10 GbE ports in a bond. Additionally, each node is equipped with 4× 25 GbE ports, which we’ve used to create a high-speed interconnect between the nodes for fast local migration and replication. On one of the hosts...
  5. H

    What is still not working in an IPv6 only (mesh network) setup

    In this thread I'd like to put all the things that still is not working 100% for a pure IPv6 deployment of a Proxmox PVE cluster (Typically in a mesh type setup). I miss a Wiki page so want to use this as that in the mean time - well.. I do push some IPv6 envelopes ;) I'd like to add the work...
  6. W

    FRR OpenFabric creating a loop (?) in full mesh Ceph setup after reconnecting the interface

    Hello, I have 4 Proxmox nodes with 2x10G interfaces. I am testing out a configuration without a switch. I have followed the tutorial in the https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server The only difference between my setup and the setup in the tutorial is the addition of the...
  7. A

    Ceph Routed Setup (with Fallback) - time outs

    Hi, I tried to configure a Ceph routed setup with fallback according to this post: Routed Setup (with Fallback). Everything seems to work and the status is ok, but `journalctl -u frr` shows a lot of time outs: Oct 03 13:52:02 host3 fabricd[2563]: [NT6J7-1RYRF] OpenFabric: Initial...