I have posted this in a couple of other places so forgive me if you have already seen it but I haven't gotten any meaning full responses as of yet.
I am at a bit of a loss here I have 4 Proxmox hosts all on 7.3-3 I am trying to configure as a home lab and wanted to try and put clustering services on their own vLan with it's on a dedicated set of interfaces on each host with the goal being to upgrade to 10gb cards in the future because I only have 1gb switch available right now. So here is the issue I'm running into. I am not getting link lights on either the switch or the interface on 3 of 4 hosts. I am fairly sure it's not networking at this point but will include my troubleshooting steps below.
Host 1 , 2 and 3 are all custom builds and have a total of 5 interfaces each.
- One onboard
- Two dual port cards
Host 4 is an old r720
- four on onboard
- One dual port card
Host 3 is the only one that is getting a link light so I have swapped it's cable to each of the other hosts (keeping the same switch port) making sure to use the same port that is currently not working. This had no affect on the other 3 hosts.
The management interfaces are also connected to this switch and are using ports 1 - 6 (two spaces for adding hosts) the interfaces I'm trying to cluster are using 7 - 12 on the switch. I was recommended to check STP to make sure its not getting disabled because it's getting caught in some kind of loop. From what I understand this is not the case but I have included the results in case I'm being dumb.
Interface Role Sts Cost Prio.Nbr Type
Gi2/0/1 Desg FWD 4 128.57 P2p
Gi2/0/2 Desg FWD 19 128.58 P2p
Gi2/0/3 Desg FWD 4 128.59 P2p
Gi2/0/5 Desg FWD 4 128.61 P2p
Gi2/0/22 Desg FWD 4 128.78 P2p
Gi2/0/47 Desg FWD 4 128.103 P2p
I have also attempted to swap ports 1 - 6 and 7 - 12 to see if i got link lights when the management interfaces were connected to 7 - 12. 1 and 7 both go to host 1 and so on. When I do this I get link lights on ports 7-12 and none on 1 - 6 which tells me that it's an issues with the hosts not the switch.
Host 1 and 2 are using the same model NIC (taken from host 4) Host 3 is using a PCIe 1gb NIC and host 4 is using one of the other on board interfaces.
I have created virtual bridges for each host they are all the same aside from the last octet of the address and the bridge port interface.
auto vmbr1
iface vmbr1 inet static
address 10.0.90.1/27
bridge-ports eno2
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
I have also checked the interface status on each of the hosts and they all report as down so I'm not plugged into the wrong port. I have manually set each interface to on each host to up and still no link lights and the interface still reports as down.
While researching I have seen mentioned that it could be auto negotiation breaking down these seem to match up as well at 1gb. Also seeing that 3 of 4 hosts are having issues but eno2 is on the same bus as eno1 which was able to autonegotiation with the same switch. Also as stated before I was able to take the working cable / switch port form host 3 and plug it into each of the non working interfaces on the other hosts and didn't get link lights.
If someone could give me an idea of where to go next or something to read up on I would be more then grateful!
I am at a bit of a loss here I have 4 Proxmox hosts all on 7.3-3 I am trying to configure as a home lab and wanted to try and put clustering services on their own vLan with it's on a dedicated set of interfaces on each host with the goal being to upgrade to 10gb cards in the future because I only have 1gb switch available right now. So here is the issue I'm running into. I am not getting link lights on either the switch or the interface on 3 of 4 hosts. I am fairly sure it's not networking at this point but will include my troubleshooting steps below.
Host 1 , 2 and 3 are all custom builds and have a total of 5 interfaces each.
- One onboard
- Two dual port cards
Host 4 is an old r720
- four on onboard
- One dual port card
Host 3 is the only one that is getting a link light so I have swapped it's cable to each of the other hosts (keeping the same switch port) making sure to use the same port that is currently not working. This had no affect on the other 3 hosts.
The management interfaces are also connected to this switch and are using ports 1 - 6 (two spaces for adding hosts) the interfaces I'm trying to cluster are using 7 - 12 on the switch. I was recommended to check STP to make sure its not getting disabled because it's getting caught in some kind of loop. From what I understand this is not the case but I have included the results in case I'm being dumb.
Interface Role Sts Cost Prio.Nbr Type
Gi2/0/1 Desg FWD 4 128.57 P2p
Gi2/0/2 Desg FWD 19 128.58 P2p
Gi2/0/3 Desg FWD 4 128.59 P2p
Gi2/0/5 Desg FWD 4 128.61 P2p
Gi2/0/22 Desg FWD 4 128.78 P2p
Gi2/0/47 Desg FWD 4 128.103 P2p
I have also attempted to swap ports 1 - 6 and 7 - 12 to see if i got link lights when the management interfaces were connected to 7 - 12. 1 and 7 both go to host 1 and so on. When I do this I get link lights on ports 7-12 and none on 1 - 6 which tells me that it's an issues with the hosts not the switch.
Host 1 and 2 are using the same model NIC (taken from host 4) Host 3 is using a PCIe 1gb NIC and host 4 is using one of the other on board interfaces.
I have created virtual bridges for each host they are all the same aside from the last octet of the address and the bridge port interface.
auto vmbr1
iface vmbr1 inet static
address 10.0.90.1/27
bridge-ports eno2
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
I have also checked the interface status on each of the hosts and they all report as down so I'm not plugged into the wrong port. I have manually set each interface to on each host to up and still no link lights and the interface still reports as down.
While researching I have seen mentioned that it could be auto negotiation breaking down these seem to match up as well at 1gb. Also seeing that 3 of 4 hosts are having issues but eno2 is on the same bus as eno1 which was able to autonegotiation with the same switch. Also as stated before I was able to take the working cable / switch port form host 3 and plug it into each of the non working interfaces on the other hosts and didn't get link lights.
If someone could give me an idea of where to go next or something to read up on I would be more then grateful!