Proxmox Netapps Top of Rack

dazmac

New Member
Aug 19, 2024
4
1
3
Hi, We are using 2 Cisco 9500 for a Top of Rack Solution for Proxmox and Netapps.
The proxmox is connected to the Netapps via LACP bonding on the 2 9500 Cisco switches.

When I do an upgrade on the two 9500 switches I am using the ISSU method with 5 second outage.

This outage causing massive problems linking Proxmox with Netapps.

Is there another solution for Top of Rack.
 
Hi @dazmac ,

Perhaps you can clarify your inquiry:

- Are both sides (Netapp and PVE) using LACP?
- Are the 9500 MLAG connected?
- I am not overly familiar with variations of the ISSU, why have you highlighted 5 seconds? Are there other options available?
- What protocol/storage are you using?
- Can you be more specific in defining "massive problems" ?

Finally, when you are asking for "another solution for Top of Rack" - are you looking to replace LACP, Cisco, something else?
Cisco has been a reliable vendor, Mellanox is the best, FS and similar give both the run for their money.

PS it sounds from your initial presentation that this is a recurring issue, how often are you upgrading your Cisco switches?


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
Last edited:
Initially we were using LACP with the 2 X 9500 switches.
When the switches were restarted after an IOS Upgrade.
Proxmox lost connectivity with Netapps.
We had to restart all the VMs in Proxmox.

We changed the configuration not to use LACP
We had half connections on 9500 switch and half on a 9300 switch.
We ran the ISSU upgrade on the 9500 switches and hoped for no downtime.
we had 5 seconds of downtime.
After the 5 seconds of downtime we noticed an error with snap mirror on
Proxmox.

We are also getting errors with our Extrahop security device as it is performing a layer 2 discovery. Multiple MAC addresses everywhere and nodes are getting multiple IP address from different subnets.

Just wondering how others have set up Proxmox Netapps and top of rack solution.

If we get a new Top of Rack we will need to upgrade the firmware.
 
Although you have not provided the requested information, the additional details you did provide point to a not-ideally configured network infrastructure.
Are you working with your network team specialist?
If not, you should definitely review the configuration with them - top-to-bottom. If you don't have such person on staff, perhaps a Partner/Consultant can help.

To answer your question: yes, people, including our customers, have been successfully using Cisco switches with LACP, Netapp, Dell, Hitachi and PVE.

Cheers


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox