corosync

  1. S

    How to best use multiple NICs

    Greetings Proxmoxians! I am on the cusp of building a new cluster with 3 Dell servers. Each server has two dual-port 25Gb/s NICs, for a total of 4 ports. From a high-level, I'm counting roughly 4 functions that the network needs to perform: Management access (SSH and web UI) to the hosts...
  2. L

    Missing information about creating 2nd ring in Ceph in documentation, and impossibility to create 2nd ring in Ceph.

    Hi, I run in my homelab a 3xnode cluster with ceph, 3xmons, 3xmgr, 3xmds. I run it for about ~3 years now. Yesterday I've installed fresh 3x nodes and migrated my cluster from old nodes to a 3x new one, which are identical (GMKTEC M5 Plus, 24GB RAM each, beautiful devices, works like a charm so...
  3. W

    Feature request: Dedicated quorum node

    Hello, I'm a system engineer at an IT outsourcing company. My job is to design and deploy virtualization solutions. I've used Proxmox for many years now, but only recently our company started to offer Proxmox as an alternative to ESXi/HyperV. I know Proxmox throughout and know its capabilities...
  4. R

    Cluster setup: corosync.conf had mixed ipv4/6 node entries after reboot

    While joining the cluster with node "standby", i used ipv4 adresses only , but we ended up with this: # cat /etc/corosync/corosync.conf logging { debug: off to_syslog: yes } nodelist { node { name: m9 nodeid: 1 quorum_votes: 1 ring0_addr: 83.a.b.c } node { name...
  5. L

    latest update for proxmox community edition 8.3.5 broke corosync

    I have 8.3.5 proxmox. After latest update I have under loop, every 2-5 seconds, receiving next message for all cluster nodes: Apr 04 22:17:04 prx-01 corosync[1488]: [KNET ] udp: Received packet on ifindex 1664013570 when expected ifindex 3 Apr 04 22:17:04 prx-01 corosync[1488]: [KNET ]...
  6. O

    Proxmox-Cluster mit 2 Knoten, Probleme bei Niedergang eines Knotens

    Homelab-Umgebung. Ich habe ein Proxmox-Cluster mit 2 Proxmox-Servern aufgezogen, kein dritter Quorum-Client mit dazugehängt. Das Cluster war recht einfach einzurichten: cluster/pm1 (alle Vserver zuerst hier) cluster/pm2 (noch kein Vserver hier) Danach habe ich alle Vserver von pm1 nach pm2...
  7. E

    [SOLVED] Only run single node in cluster

    Hi, I have a two node cluster configured, home setup. I have a primary node with all the needed services running. The secondary node is actually empty at the moment and not really needed. I plan on building it up, maybe, and have it available to migrate things as needed. For the time being...
  8. A

    Adding QDevice fails

    Attempting to add an "external" QDevice. Output is as follows...not sure I understand how to fix this (and on which machine)? root@pve2:~# pvecm qdevice setup 192.168.1.58 -f /bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub" /bin/ssh-copy-id: INFO: attempting to...
  9. N

    Should redundant corosync links be on seperate VLAN?

    After reading through PVE CM Redundancy, I am left wondering whether or not there is any reason not to use the same VLAN for the two separate physical corosync links? I see the example shows what presumably are separate subnets, but I see no explicit mention on whether or not such a logical...
  10. W

    Correct way to set MTU on a Corosync cluster network (pve 8.3)

    Looking for some guidance on the how to correctly set the MTU for a cluster with a dedicated / separate network for Corosync traffic. I have a (rather) simple setup of 3 pve nodes, each having 2 physical interfaces: enp65s0: A mellanox fiber nic. Used by corosync in ring config (see below) for...
  11. O

    (pvecm) qdevice setup fails, can't get fixed pve-cluster package.

    Recently, I've added multiple qdevices to several clusters running older versions of PVE without any issues, using command: pvecm qdevice setup 192.168.1.xxx -f and corosync-qdevice. Issue regarding certificate authentication. However, my latest 2-node cluster is running VE 8.2.2, where the...
  12. P

    Automatically reduce quorum nodes after partial cluster shutdown

    Hello, From what I see, the corosync uses max number of cluster nodes+1 as a quorum for the cluster. So in 11 node cluster, 6 is the quorum. This is logically ok, but in real life scenarios, I need to have part or cluster to shutdown, and if shut down part is 5, then one more node and cluster...
  13. E

    [KNET] link: host: X link: 0 is down - if a tree falls in a forest ...

    ... and nobody heard it, did it make a sound? How often (per month, year?) do you get the [KNET ] link: host: X link: 0 is down on otherwise healthy network in production dedicated redundant setups without losing quorum? Does anyone check? How many nodes are there in your cluster? Is that...
  14. G

    Adding Corosync External Vote Support

    Hi, thank you for accepting me into this community. I have set up a new cluster for production (my first non vSPhere cluster) and I am running into a little problem. Given that we have a 4 node cluster I wanted to add additional quorum following the Instructions from the manual...
  15. J

    Re-create cluster with just corosync.conf on nodes?

    PVE 8.2 I have configured a 4 node cluster, and am wondering if it is possible to just copy corosync.conf to /etc/pve/corosync.conf and /etc/corosync/corosync.conf to my nodes if i were to start from scratch (fresh install of pve) on all nodes. Would this create and "join" the nodes to the...
  16. A

    Node1 Unexpected Restarts Despite Configuration Adjustments - HA

    Hi everyone, I'm experiencing an issue where NODE1 in my Proxmox VE cluster is restarting when both NODE2 and NODE3 are powered off, even after I've made several adjustments to the corosync.conf configuration. Below is a summary of the setup and the steps I've taken: Configuration Overview...
  17. B

    Qdevice NR status (pvecm status)

    When i look at pvecm status i see that 3 of my nodes have NR status , that mean not reachebol, sould not all nodes have de status a,v,nmw? root@proxmox4-int:~# pvecm status Cluster information ------------------- Name: HCC-hobbynet Config Version: 27 Transport: knet...
  18. A

    Frequent Watchdog reboots

    I am relatively new to Proxmox and have a cluster running with 3 nodes, everything is currently working fine, cluster is up HA is running fine. The issue I face currently is that in case the cluster link goes down for let's say more than 10s, watchdog kicks in and reboots the server, this causes...
  19. F

    Corosync 2Nodes + QDev // Backup network design

    Hello together, I'd like to build a PVE HA Cluster out of 2 PVE Nodes and 1 QDev to get quorum. In order to get a nice and stable Corosync Link, I've a dedicated 1G NIC via Crossover LAN between the 2 PVE nodes. The QDev VM is a external hosted system and can't be connected via LAN. The Plan...
  20. F

    [SOLVED] Error when adding QDevice to existing cluster

    Hi everyone, I'm currently facing a problem when adding a QDevice to a 2-node cluster. Current cluster: 2x Proxmox VE 8.2.2 QDevice: 1x Proxmox Backup-Server 3.2-2 - I can remote from both nodes into PBS as root - corosync-qdevice is installed on both nodes - corosync-qnetd and...