corosync

  1. node seems to be offline

    Hello guys I had a problem using proxmox in my Debian machine. my problem are in the web GUI when I want to create a VM it shows a warning that the node seems to be offline like this image. but if I navigate to the node information it says online and have uptime like this image. and this...
  2. [SOLVED] corosync no active links

    Hi, our new cluster is being prepaired for use and while slowly starting to use the cluster i see some messages in syslog: Dec 25 06:27:52 prxa06 pmxcfs[4868]: [dcdb] notice: data verification successful Dec 25 06:34:26 prxa06 corosync[5041]: [TOTEM ] Retransmit List: b819f Dec 25 06:35:35...
  3. reboot of all cluster nodes when corosync is restarted on specific member

    Hey all, I observed a strange reboot off all my cluster nodes as soon as on one specific host cororsync is restarted or this host rebooted. I have 7 hosts in one cluster Corosync has 2 links configured. ring0 is on a separate network on separate switch. ring1 is shared as VLAN over 10G fiber...
  4. Upgrade Cluster Corosync - Ignore Script ?

    Currently running 4 node Promox cluster 5.4-15 with Ceph and trying to upgrade to Proxmox 6 and then hopefully Proxmox 7. I have followed all the instructions documented on your site including https://pve.proxmox.com/wiki/Upgrade_from_5.x_to_6.0#Cluster:_always_upgrade_to_Corosync_3_first The...
  5. [TUTORIAL] Adding a secondary corosync network for failover - setting the priority when adding a 2nd corosync network to upgrade to a redundant ring network.

    SCROLL TO THE END FOR AN EXAMPLE ADD knet_link_priority: <value> TO YOUR /etc/pve/corosync.conf FILE UNDER THE TOTEM DIRECTIVE AND EACH RESPECTIVE INTERFACE SUBDIRECTIVE Here is the guide on creating a separate cluster network: https://pve.proxmox.com/wiki/Separate_Cluster_Network MY OBJECTIVE...
  6. Expected behavior from watchdog-mux with a networking outage? (HA, Corosync, and Softdog fencing)

    What’s the expected behavior here? I have a 3-node cluster with dedicated physical corosync network, and a 2nd faster network for storage and networking. The corosync network is configured to failover to the fast network if interrupted. High availability is configured on guests with shared...
  7. Corosync - nsscrypto: Incorrect packet size

    Hello, after upgrading from pve6 to pve7, the syslog of both servers is spammed with: corosync[8001]: [KNET ] nsscrypto: Incorrect packet size. After some googleing I haven't found a solution yet. Hopfefully someone can help. Edit (Solution): Related corosync github issue The reason was the...
  8. Primary Corosync Link Failure, Redundant Link Not Taking Over

    Hello all, Before I begin I want to thank you all for your great posts/replies here. We've been using Proxmox for over 1 year and have never made a post as we've always found the answers here by searching (and that could be the case here, but I'm currently on vacation and wife gonna kill me if...
  9. Adding second corosync ring best practice

    We upgraded the proxmox to 7. with latest ceph. and almost everything back to normal.. Currently our main network is the same network with the corosync and consists of 11 nodes, (4 of them with ceph) We plan to double the server count in the near future and i thinking of moving the corosync...
  10. Proxmox cluster lost synchronization

    Hello, Today our cluster lost synchronization. Most of the nodes were shown as offline or unknown. The nodes were up but every node could see only itself and few other nodes. Restarting the pve-cluster and corosync didn't help so we brought everything down and started them one by one. For most...
  11. TwiX

    PVE7 - corosync upgrade rebooted all nodes !

    Hi, I tried to upgrade a 6 nodes pve7 cluster yesterday. We use Ceph and HA for all VMs. I was able to upgrade 4 nodes without issue. But on the fifth node, I lost the whole cluster. All nodes rebooted ! Syslogs for nodes 22 to 27 : update ok for nodes 22,23,24 and 27 upgrade of node 25...
  12. Upgrade proxmox from 5 to 6

    Hello, what is the best choice for a 12-node cluster? 1) Upgrade nodes one by one. Initially, the newly upgraded node(s) will not have be quorate on their own. Once at least half of the nodes plus one have been upgraded, the upgraded partition will become quorate and the not-yet-upgraded...
  13. Some notes and questions about Proxmox Cluster networking

    Hello, I am trying to find more information about Proxmox Cluster networking, and specially the use of ports 22, 5404 and 5405 for intra cluster communication. I feel like the PVE admin guide could be updated with more accurate information (some of which I am contributing in this thread). I...
  14. Issues joining new servers to clusters

    Hi All, I appreciate any feedback I get here. I have an existing 5 node cluster. It runs Ceph, but I dont believe this is applicable to the situation, but thought to mention it. I also have an existing 3 node cluster. No shared storage. I've migrated everything away from the 3 node cluster and...
  15. 48 node pve cluster

    Hello everyone, we're running a 48 node pve cluster with this setup: AMD EPYC 7402P, 512GB Memory, Intel X520-DA2 or Mellanox Connect X3 NIC, Ceph Pool with only NVMe, 2x 10Gbit/s interfaces (for cluster traffic) + 2x 1G (for public traffic). As a few others have recently reported in the forum...
  16. Adding node to cluster crash all nodes from it

    Hi, tonight is the second time I face a huge problem when trying to add a node to my existing cluster. My cluster contains approximately 15 nodes, I use CEPH as storage and everything is working pretty good. All our nodes and "future" nodes FQDN are contained in /etc/hosts like : -...
  17. Qdevice is not voting

    Hello guys, I have a problem with my Qdevice. If I type "pvemc status", my first node give the following result: root@pve1:~# pvecm status Cluster information ------------------- Name: server Config Version: 7 Transport: knet Secure auth: on Quorum information...
  18. Whole cluster randomly rebooted twice (maybe corosync?)

    Dear all, I am currently dealing with a problem in a hyperconverged (ceph) where the whole cluster reboots seemingly at random. Every single one (of the total of seven) node resets at the same time. I am suspecting corosync to not be able to communicate properly. This problem has only popped up...
  19. 1x NIC to 2x NICs (Keep VMs/WAN on 1st & Move PVE/Corosync/etc to 2nd)

    Hi there, I'm looking to update the networking setup for Proxmox VE now that the switches have been swapped out for more capable models. At the moment, each host has 1x NIC connected, which is serving VMs (WAN) and PVE (Web GUI, SSH, Corosync, etc). Static addressing for PVE is set against...
  20. Multiple cluster in corosync

    Hello all, May be someone can help, how to add second PVE cluster (as observer) in already exist PVE Cluster. How i can add here second separate CLUSTER-2? # cat /etc/pve/corosync.conf nodelist { node { name: n1 nodeid: 1 quorum_votes: 1 ring0_addr: n1 mcastaddr...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!