Calling on the hive mind: networking issue from hell

proxwolfe

Well-Known Member
Jun 20, 2020
506
56
48
49
Hi,

so I have a small home lab cluster of 3 PVE nodes and one additional PBS. And I have the following networks (each on separate NICs/cables/switches):

- Management
- Corosync
- Ceph
- Backup

The PVE nodes are connected to all networks. The PBS in only connected to Management and Backup.

All PVE nodes see each other on all networks and can see the PBS both on the management network as well as on the backup network.

Recently I replaced one of the PVE nodes with newer hardware. This new node can see (ping) all the other nodes on all networks (including on backup) but it cannot see the PBS.

How can that be? If the NIC on the new node connected to the backup network were defective, the new node should not be able to see the other nodes on that network, it should see nothing at all. But it can see the other nodes also on the backup network. And the other nodes also can see the new node on the backup network. So why can the new node not see the PBS???

What is going on?

Is it possible that the new node's NIC is defective after all and PVE somehow routes the pings on the PVE only networks around the broken NIC (and that only works within the PVE cluster but not outside and therefore does not work with PBS)? I know, this sounds crazy but it is the best (only) explanation I have come up so far.

Any ideas?

Thanks
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!