corosync

  1. Enable second corosync ring

    Hi guys! I stucked and need help. I have cluster (8 nodes) and tried add vLAN for corosync. When I modified corosync.conf file on non-master node, new file not modified on another nodes, but when I modified corosync.conf on master node, and restarted corosync service system rewrite file (delete...
  2. Remove corosync ring 0(link0) network without rebooting nodes

    Hi all, We have 12 node cluster with 6x ceph nodes and 6x compute nodes.(ceph nodes not running any vms). corosync connected via two links. one dedicated link and one shared (mgmt) link. Ceph configured with dedicated backend sync network as well We are changing some of the switch config and...
  3. Replacing switch responsible for cluster

    We need to replace a 10Gbe switch that is responsible for Link 0 in our cluster. The switch is failing lately with several unscheduled reboots. Every time the switch rebooted, our whole cluster went down and the individual nodes rebooted even though we have another two rings in the cluster...
  4. Re-IP Ceph cluster & Corosync

    Updated a Ceph cluster to PVE 7.2 without any issues. I've just noticed I'm using the wrong network/subnet for the Ceph public, private and Corosync networks. It seems my searching skills are failing me on how to re-IP Ceph & Corosync networks. Any URLs to research this issue? Thanks for...
  5. Found a bug with using IPv6-based clustering; also a hostname error

    Hey all. There seems to be two bugs regarding clustering setup and IPv6 addresses... 1. If you decide to use custom fe80:: addresses on a vlan/other interface, it may default to the primary network interface regardless (i.e. vmbr0 vs vlan###). 2. If you use a routed address, and it has a :: in...
  6. Corosync is not working and I can't log in to the web console.

    Please help. Cluster stopped working. After rebooting the server vm does not start. From the console, too, it is not possible to launch them. pvecm status Cluster information ------------------- Name: asodesk Config Version: 52 Transport: knet Secure auth: on Quorum...
  7. Configuring Dual Corosync Networks

    Hello Everyone, Right now I am finally jumping into my Proxmox Ceph Cluster Project I have been waiting to work on for months now. So far, things have been going smoothly in terms of getting the Cluster created, however I am somewhat unsure as to whether I have a proper understanding of the...
  8. node seems to be offline

    Hello guys I had a problem using proxmox in my Debian machine. my problem are in the web GUI when I want to create a VM it shows a warning that the node seems to be offline like this image. but if I navigate to the node information it says online and have uptime like this image. and this...
  9. [SOLVED] corosync no active links

    Hi, our new cluster is being prepaired for use and while slowly starting to use the cluster i see some messages in syslog: Dec 25 06:27:52 prxa06 pmxcfs[4868]: [dcdb] notice: data verification successful Dec 25 06:34:26 prxa06 corosync[5041]: [TOTEM ] Retransmit List: b819f Dec 25 06:35:35...
  10. reboot of all cluster nodes when corosync is restarted on specific member

    Hey all, I observed a strange reboot off all my cluster nodes as soon as on one specific host cororsync is restarted or this host rebooted. I have 7 hosts in one cluster Corosync has 2 links configured. ring0 is on a separate network on separate switch. ring1 is shared as VLAN over 10G fiber...
  11. Upgrade Cluster Corosync - Ignore Script ?

    Currently running 4 node Promox cluster 5.4-15 with Ceph and trying to upgrade to Proxmox 6 and then hopefully Proxmox 7. I have followed all the instructions documented on your site including https://pve.proxmox.com/wiki/Upgrade_from_5.x_to_6.0#Cluster:_always_upgrade_to_Corosync_3_first The...
  12. [TUTORIAL] Adding a secondary corosync network for failover - setting the priority when adding a 2nd corosync network to upgrade to a redundant ring network.

    SCROLL TO THE END FOR AN EXAMPLE ADD knet_link_priority: <value> TO YOUR /etc/pve/corosync.conf FILE UNDER THE TOTEM DIRECTIVE AND EACH RESPECTIVE INTERFACE SUBDIRECTIVE Here is the guide on creating a separate cluster network: https://pve.proxmox.com/wiki/Separate_Cluster_Network MY OBJECTIVE...
  13. Expected behavior from watchdog-mux with a networking outage? (HA, Corosync, and Softdog fencing)

    What’s the expected behavior here? I have a 3-node cluster with dedicated physical corosync network, and a 2nd faster network for storage and networking. The corosync network is configured to failover to the fast network if interrupted. High availability is configured on guests with shared...
  14. Corosync - nsscrypto: Incorrect packet size

    Hello, after upgrading from pve6 to pve7, the syslog of both servers is spammed with: corosync[8001]: [KNET ] nsscrypto: Incorrect packet size. After some googleing I haven't found a solution yet. Hopfefully someone can help. Edit (Solution): Related corosync github issue The reason was the...
  15. Primary Corosync Link Failure, Redundant Link Not Taking Over

    Hello all, Before I begin I want to thank you all for your great posts/replies here. We've been using Proxmox for over 1 year and have never made a post as we've always found the answers here by searching (and that could be the case here, but I'm currently on vacation and wife gonna kill me if...
  16. Adding second corosync ring best practice

    We upgraded the proxmox to 7. with latest ceph. and almost everything back to normal.. Currently our main network is the same network with the corosync and consists of 11 nodes, (4 of them with ceph) We plan to double the server count in the near future and i thinking of moving the corosync...
  17. Proxmox cluster lost synchronization

    Hello, Today our cluster lost synchronization. Most of the nodes were shown as offline or unknown. The nodes were up but every node could see only itself and few other nodes. Restarting the pve-cluster and corosync didn't help so we brought everything down and started them one by one. For most...
  18. TwiX

    PVE7 - corosync upgrade rebooted all nodes !

    Hi, I tried to upgrade a 6 nodes pve7 cluster yesterday. We use Ceph and HA for all VMs. I was able to upgrade 4 nodes without issue. But on the fifth node, I lost the whole cluster. All nodes rebooted ! Syslogs for nodes 22 to 27 : update ok for nodes 22,23,24 and 27 upgrade of node 25...
  19. Upgrade proxmox from 5 to 6

    Hello, what is the best choice for a 12-node cluster? 1) Upgrade nodes one by one. Initially, the newly upgraded node(s) will not have be quorate on their own. Once at least half of the nodes plus one have been upgraded, the upgraded partition will become quorate and the not-yet-upgraded...
  20. Some notes and questions about Proxmox Cluster networking

    Hello, I am trying to find more information about Proxmox Cluster networking, and specially the use of ports 22, 5404 and 5405 for intra cluster communication. I feel like the PVE admin guide could be updated with more accurate information (some of which I am contributing in this thread). I...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!