Hi All,
Just migrated from EXSI to proxmox very excited to get familiar with it.
I have one server that i run proxmox to virtualise TrueNAS and few VMs to learn. as well Mac Pro as my main machine and iMac. i upgraded the server with 10g network and would like to use it to maximise performance of the storage speed, security and the system as a whole. see below my setup is as follows:
Proxmox / NAS Supermicro Server
iMac - 1G Interface x 1
UniFi Pro 48 POE L3 Switch P1 10G > Proxmox P1 10G > Linux Bridge vmbr0 > 10G LAN / Management Subnet, ATM has TrueNAS VM for Time Machine, SMB and NFS SATA Share Subnet (HBA Passthrough IT Mode).
UniFi Pro 48 POE L3 Switch P2 10G > Proxmox P2 10G > Linux Bridge vmbr1 > 10G VM Subnet / Local ZFS SSD datastore (HBA IT Mode).
UniFi Pro 48 POE L3 Switch P1 1G > Proxmox P1 1G > ??? Future Subnet
UniFi Pro 48 POE L3 Switch P2 1G > Proxmox P2 1G > ??? Future Subnet
Mac Pro 10G P1> P3 10G UniFi Pro 48 POE L3 Switch > Linux Bridge vmbr0 > 10G LAN / Management Subnet / Proxmox / Time Machine
Mac Pro 10G P2 > P4 10G UniFi Pro 48 POE L3 Switch > Linux Bridge vmbr1 > TrueNAS 10G SMB Share SATA subnet
iMac 1g P1 > UniFi Pro 48 POE L3 Switch > 1G LAN SMB Share SATA and Time Machine TrueNAS subnet
Proxmox Network VLANS - LAN & VM.
Using that setup my test result was as follows:
iperf test
MAC Pro > < TureNAS (both ways) on both vmbr0 and vmbr1 = 10G
VM>< VM = 25G
25gb File transfer over SMB
MAC Pro > < TureNAS (both ways) on both vmbr0 and vmbr1 = 4.5gbps
i was happy with the results above however had few issues with that setup.
1. when transferring file from the MAC Pro > TureNAS over SMB it goes only through LAN subnet / Linux Bridge vmbr0 insted of the vmbr1, making Linux Bridge vmbr1 subnet redundant on the MacPro. even if i bind the subnets on truenas it will still use the LAN network.
2. when using the second interface / vmbr1 VM subnet i need to share my machine which is unsecured. As well i prefer not do have L3 routing between the MAC PRO and TrueNAS just L2.
to summarise, it sounds like i need x 3 10G physical Interfaces / subnets : LAN, VM and L2 SMB via the switch between the MAC PRO.
Few questions and thoughts:
- how do i configure the proxmox network with only 2 10g physical ports?
- Do i need to create VLANS for the VM on the Router and switch or i can do that through the proxmox networking?
- Any suggestion what good use for the spare two 1g ports?
- MAC PRO Is it good idea to use two subnets LAN and SMB or use one interface for both?
- Any good tutorials or information to learn about proxmox especially network part how it works..etc ? all the information i found was only basic bridge setup.
i saw some use OVS switches and VLANS, i'm new to proxmox network still learning.
apologies for the long post however i want to make sure i provide all the information.
Thank you in advance
Just migrated from EXSI to proxmox very excited to get familiar with it.
I have one server that i run proxmox to virtualise TrueNAS and few VMs to learn. as well Mac Pro as my main machine and iMac. i upgraded the server with 10g network and would like to use it to maximise performance of the storage speed, security and the system as a whole. see below my setup is as follows:
Proxmox / NAS Supermicro Server
- PCIE 10G SFP+ Interfaces x 2
- 1G Interfaces x 2
- HBA PCIE IT Mode - Proxmox ZFS SSD datastore
- HBA PCIE Passthrough IT Mode - TrueNAS ZFS SMB NFS Share SATA
- PCIE M.2 Optane SSD - TrueNAS SLOG/SWAP/L2ARC
- 10G /SFP+ Interfaces x 4
- 1G Interfaces x 48
iMac - 1G Interface x 1
UniFi Pro 48 POE L3 Switch P1 10G > Proxmox P1 10G > Linux Bridge vmbr0 > 10G LAN / Management Subnet, ATM has TrueNAS VM for Time Machine, SMB and NFS SATA Share Subnet (HBA Passthrough IT Mode).
UniFi Pro 48 POE L3 Switch P2 10G > Proxmox P2 10G > Linux Bridge vmbr1 > 10G VM Subnet / Local ZFS SSD datastore (HBA IT Mode).
UniFi Pro 48 POE L3 Switch P1 1G > Proxmox P1 1G > ??? Future Subnet
UniFi Pro 48 POE L3 Switch P2 1G > Proxmox P2 1G > ??? Future Subnet
Mac Pro 10G P1> P3 10G UniFi Pro 48 POE L3 Switch > Linux Bridge vmbr0 > 10G LAN / Management Subnet / Proxmox / Time Machine
Mac Pro 10G P2 > P4 10G UniFi Pro 48 POE L3 Switch > Linux Bridge vmbr1 > TrueNAS 10G SMB Share SATA subnet
iMac 1g P1 > UniFi Pro 48 POE L3 Switch > 1G LAN SMB Share SATA and Time Machine TrueNAS subnet
Proxmox Network VLANS - LAN & VM.
Using that setup my test result was as follows:
iperf test
MAC Pro > < TureNAS (both ways) on both vmbr0 and vmbr1 = 10G
VM>< VM = 25G
25gb File transfer over SMB
MAC Pro > < TureNAS (both ways) on both vmbr0 and vmbr1 = 4.5gbps
i was happy with the results above however had few issues with that setup.
1. when transferring file from the MAC Pro > TureNAS over SMB it goes only through LAN subnet / Linux Bridge vmbr0 insted of the vmbr1, making Linux Bridge vmbr1 subnet redundant on the MacPro. even if i bind the subnets on truenas it will still use the LAN network.
2. when using the second interface / vmbr1 VM subnet i need to share my machine which is unsecured. As well i prefer not do have L3 routing between the MAC PRO and TrueNAS just L2.
to summarise, it sounds like i need x 3 10G physical Interfaces / subnets : LAN, VM and L2 SMB via the switch between the MAC PRO.
Few questions and thoughts:
- how do i configure the proxmox network with only 2 10g physical ports?
- Do i need to create VLANS for the VM on the Router and switch or i can do that through the proxmox networking?
- Any suggestion what good use for the spare two 1g ports?
- MAC PRO Is it good idea to use two subnets LAN and SMB or use one interface for both?
- Any good tutorials or information to learn about proxmox especially network part how it works..etc ? all the information i found was only basic bridge setup.
i saw some use OVS switches and VLANS, i'm new to proxmox network still learning.
apologies for the long post however i want to make sure i provide all the information.
Thank you in advance
Last edited: