Good Day All, I'm hoping that providing some context you can possibly help me resolve my issue. I moved my existing PVE install over to a Dual SFP NIC from a former 4x1G Copper NIC. After doing so I'm no longer able to access the host, as I've gone down a rabbit hole of configuration changes I'm wondering if there is a way to 'factory' reset proxmox without losing my VM's and containers? That is, if I'm unable to resolve this issue I have. What follows is my network configuration. In the meantime I was able to configure a second server successfully in this environment in order to test out the port channel configuration on my Cisco 4500x and ensure that I wasn't losing my mind and it indeed works. I got down a rabbit hole of trying to fix the existing PVE server by applying things like Firewall, or VLAN aware to the VMs/Containers and I just feel like I've reached a point of no return. If I cannot reset PVE (perhaps a way to remove and reinstall it without affecting the VMs/Containers) is there a way to salvage the VMs/Containers and import them into the server I've subsequently built as a result of this fiasco I've self-inflicted? I'm mostly concerned with my HA VM and Unifi Controller VM. Everything else I feel like I'd be fine with losing at this point 
Some reference as well, vlan 100 is my 'data' vlan everything in the house runs on it, at some point I wanted to build out further VLANs in order to segment our network needs further (IE WLAN/Servers/IOT/Guest/etc) what prompted the SFP NIC upgrades was a desire to increase the bandwidth of my servers to better serve our home users. We have an Unraid server for our file needs (hindsight being what it is, it would've been nice to backup PVE to this) additionally our internet is fiber with 1g UP/Down with a 5G copper handoff which I have implemented VLAN 42 (the answer to everything) in order to facilitate the higher throughput, I add a 16port 4500x with a 5G Copper SFP for the internet as well as have a port channel of 2 Twinax 10G into our Cisco 3850 to increase the available bandwidth.
My intention is to move from my existing Hardware pfSense box (a Dell r410) to a HA OPNsense proxmox solution in order to have better uptime when I need to futz around with the network. Please forgive my rambling
Any help that you kind folks can provide would be much appreciated.
### Non working proxmox server ### (was working prior)
nano /etc/network/interfaces/
#10g sfp link
iface enp131s0f0 inet manual
iface enp131s0f1 inet manual
#bond lag
auto bond0
iface bond0 inet manual
bond-slaves enp131s0f0 enp131s0f1
bond-miimon 50
bond-mode 802.3ad
bond-xmit-hash-policy layer3+4
#vlan tag
iface bond0.100 inet manual
iface bond0.42 inet manual
#bridge mgmt.
auto vmbr0v100
iface vmbr0v100 inet static
address 10.0.0.254/24
gateway 10.0.0.1
bridge-ports bond0.100
bridge-stp off
bridge-fd 0
#bridge trunk
auto vmbr0
iface vmbr0 inet manual
bridge-ports bond0
bridge-stp off
bridge-fd 0
### Known working config ###
# 10G sfp twinax links
auto enp3s0f0
iface enp3s0f0 inet manual
auto enp3s0f1
iface enp3s0f1 inet manual
# LAGG interfaces
auto bond0
iface bond0 inet manual
bond-slaves enp3s0f0 enp3s0f1
bond-miimon 50
bond-mode 802.3ad
bond-xmit-hash-policy layer3+4
# VLAN tag
iface bond0.100
iface bond0.42
# MGMT interface
auto vmbr0v100
iface vmbr0v100 inet static
address 10.0.0.199/24
gateway 10.0.0.1
bridge_ports bond0.100
bridge_stp off
### Known working config ###
### Cisco 4500x output for the PVE server I'm trying to salvage ###
#sh int po100
Port-channel100 is up, line protocol is up (connected)
Hardware is EtherChannel, address is 84b8.028d.eb0c (bia 84b8.028d.eb0c)
MTU 1500 bytes, BW 20000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, media type is N/A
input flow-control is on, output flow-control is unsupported
Members in this channel: Te1/13 Te1/14
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 7000 bits/sec, 2 packets/sec
5 minute output rate 23000 bits/sec, 13 packets/sec
1768774 packets input, 536776234 bytes, 0 no buffer
Received 88328 broadcasts (66438 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 input packets with dribble condition detected
9169867 packets output, 4483778193 bytes, 0 underruns
0 output errors, 0 collisions, 4 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier
0 output buffer failures, 0 output buffers swapped out
#sh mac add int po 100
Unicast Entries
vlan mac address type protocols port
---------+---------------+--------+---------------------+-------------------------
42 bc24.11b5.b8b5 dynamic ip,ipx,assigned,other Port-channel100
100 98b7.851f.42ea dynamic ip,ipx,assigned,other Port-channel100
### Cisco 4500x output for the PVE server I'm trying to salvage ###
Some reference as well, vlan 100 is my 'data' vlan everything in the house runs on it, at some point I wanted to build out further VLANs in order to segment our network needs further (IE WLAN/Servers/IOT/Guest/etc) what prompted the SFP NIC upgrades was a desire to increase the bandwidth of my servers to better serve our home users. We have an Unraid server for our file needs (hindsight being what it is, it would've been nice to backup PVE to this) additionally our internet is fiber with 1g UP/Down with a 5G copper handoff which I have implemented VLAN 42 (the answer to everything) in order to facilitate the higher throughput, I add a 16port 4500x with a 5G Copper SFP for the internet as well as have a port channel of 2 Twinax 10G into our Cisco 3850 to increase the available bandwidth.
My intention is to move from my existing Hardware pfSense box (a Dell r410) to a HA OPNsense proxmox solution in order to have better uptime when I need to futz around with the network. Please forgive my rambling
Any help that you kind folks can provide would be much appreciated.
### Non working proxmox server ### (was working prior)
nano /etc/network/interfaces/
#10g sfp link
iface enp131s0f0 inet manual
iface enp131s0f1 inet manual
#bond lag
auto bond0
iface bond0 inet manual
bond-slaves enp131s0f0 enp131s0f1
bond-miimon 50
bond-mode 802.3ad
bond-xmit-hash-policy layer3+4
#vlan tag
iface bond0.100 inet manual
iface bond0.42 inet manual
#bridge mgmt.
auto vmbr0v100
iface vmbr0v100 inet static
address 10.0.0.254/24
gateway 10.0.0.1
bridge-ports bond0.100
bridge-stp off
bridge-fd 0
#bridge trunk
auto vmbr0
iface vmbr0 inet manual
bridge-ports bond0
bridge-stp off
bridge-fd 0
### Known working config ###
# 10G sfp twinax links
auto enp3s0f0
iface enp3s0f0 inet manual
auto enp3s0f1
iface enp3s0f1 inet manual
# LAGG interfaces
auto bond0
iface bond0 inet manual
bond-slaves enp3s0f0 enp3s0f1
bond-miimon 50
bond-mode 802.3ad
bond-xmit-hash-policy layer3+4
# VLAN tag
iface bond0.100
iface bond0.42
# MGMT interface
auto vmbr0v100
iface vmbr0v100 inet static
address 10.0.0.199/24
gateway 10.0.0.1
bridge_ports bond0.100
bridge_stp off
### Known working config ###
### Cisco 4500x output for the PVE server I'm trying to salvage ###
#sh int po100
Port-channel100 is up, line protocol is up (connected)
Hardware is EtherChannel, address is 84b8.028d.eb0c (bia 84b8.028d.eb0c)
MTU 1500 bytes, BW 20000000 Kbit/sec, DLY 10 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive set (10 sec)
Full-duplex, 10Gb/s, media type is N/A
input flow-control is on, output flow-control is unsupported
Members in this channel: Te1/13 Te1/14
ARP type: ARPA, ARP Timeout 04:00:00
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/2000/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 7000 bits/sec, 2 packets/sec
5 minute output rate 23000 bits/sec, 13 packets/sec
1768774 packets input, 536776234 bytes, 0 no buffer
Received 88328 broadcasts (66438 multicasts)
0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
0 input packets with dribble condition detected
9169867 packets output, 4483778193 bytes, 0 underruns
0 output errors, 0 collisions, 4 interface resets
0 unknown protocol drops
0 babbles, 0 late collision, 0 deferred
0 lost carrier, 0 no carrier
0 output buffer failures, 0 output buffers swapped out
#sh mac add int po 100
Unicast Entries
vlan mac address type protocols port
---------+---------------+--------+---------------------+-------------------------
42 bc24.11b5.b8b5 dynamic ip,ipx,assigned,other Port-channel100
100 98b7.851f.42ea dynamic ip,ipx,assigned,other Port-channel100
### Cisco 4500x output for the PVE server I'm trying to salvage ###