10GBe to switch SFP+ to speed connections?

[pcmofo]

Can I use a 10GBe connection between my Proxmox server and my switches SFP+ port to speed up all of the VMs connections to the rest of the 1GBe network?

My setup
I currently have Proxmox running on a supermicro board with containers for different apps.
The proxmox install manages the ZFSz2 raid which gives the containers super fast local access to that storage.
I'm running a container for crash plan, SMB shares, Plex, NVR, etc.
Currently they are all sharing the same 1GBe ethernet cable connection to my dumb switch.

I'm planning on using a managed switch, specifically the Ubiquiti 48 port switch with two 10GB SFP+ ports on it. I use the SMB share + ZFS to safely edit and manage a few TB of videos and photos from my main workstation over 1GBe. Currently I can hit about 110MB/s over GBe. I'm concerned that if I am trying to edit while someone else is watching plex or doing a crashplan edit that my available bandwidth will quickly drop as the servers are all sharing the 1GBe connection coming from Proxmox.

Yes, I have 3 other unused ports on the SM box but if I have the SFP+ port on the switch doesn't it make more sense to use the single 10GBe connection than dealing with bonding 4GBe connections?

Again, my question is kind of a technical one. When proxmox sees the 10GBe connection as it's primary shared network connection for the VMs will that be able to, for example, have two or three clients be able to max out their 1gbe connections to proxmox at the same time instead of just one?

 

[manu]

if each incoming connection is connected to a different port on your switch, then I see no reason why you shouldn't be able to max out the bandwidth on the 10GB port.

 

[guletz]

Yes theoretical it is possible. In a real life depends. One aspect is the fact that if you use kvm guests over zfs, without any tricks, I bet is not possible. Proxmox use for zfs 8k sector-size by default - a bad option in my oppinion. Also you need to rise your mtu. And depends if your zfs / storage can deliver so much data. And a lot of others things ... unnumbered (linux optimisation like sysctl and so on).
And is about your switch , many of them have a lot of ... trash in the box If you read the paper specifications , are very good, but in the real life this specifications are only dreams. So I think that you need to ckeck if your box is a dream-box or a decent one

 

[CloudHopping]

We are doing exactly this on one of our clusters - and it works extremely well.
I might add we are NOT using storage on the Proxmox Systems but rather within a NAS/SAN however.

For sure however play with your MTU settings.
Be careful however - you stated your using a dumb switch - if it does not support jumbo frames DO
NOT use MTU frames larger than the standard - or you will just be in trouble