Hello,
We have a 6 nodes cluster (PVE 5.2) with mixed storage: 20TB in Ceph and 10TB in a NetApp appliance, two separates lans with vlan, one for storage (LACP 2 x 10Gbps each server) and one for production (LACP 2 x 10Gbps each server) this core is 9 years old and we are planning to get a new one.
The new one will begin with 4 nodes Dell EMC R750 with this configuration each one:
Now we are in discussion about de hard discs drives: SAS SSD vs NVMe SSD. We have been reading the 2020 and 2018 Proxmox Ceph Benchmarks and is obvious that NVMe drives are faster than SAS, and we know that 25Gbps LAN with NVMe discs can be a bottleneck but we can add 2 more 25Gbps ports per node creating 4 x 25Gbps LACP for SAN (is not the same that a 100Gbps port, but is near).
We are trying to know if Proxmox is able to hot plug NVMe discs, we know that hot plug is working properly with SAS SSD drives, and Dell has implemented PCIe hot plug in his hardware, but has been implemented PCIe hot plug in Proxmox kernel?
Thanks,
Xavier.
We have a 6 nodes cluster (PVE 5.2) with mixed storage: 20TB in Ceph and 10TB in a NetApp appliance, two separates lans with vlan, one for storage (LACP 2 x 10Gbps each server) and one for production (LACP 2 x 10Gbps each server) this core is 9 years old and we are planning to get a new one.
The new one will begin with 4 nodes Dell EMC R750 with this configuration each one:
- 2 x Intel Xeon Silver 4316
- 512GB RAM
- 2 x dual 25Gbps port adapters.
- 1 x 4 1Gbps port adapter.
- 8 x SAS SSD 1'9TB.
- 1 x Nvidia Ampere A16. We need GPUs for Microsoft Windows RDP clients (using Guacamole), video works (Milestone) and Big Data and analytics (Apache Foundation tools).
Now we are in discussion about de hard discs drives: SAS SSD vs NVMe SSD. We have been reading the 2020 and 2018 Proxmox Ceph Benchmarks and is obvious that NVMe drives are faster than SAS, and we know that 25Gbps LAN with NVMe discs can be a bottleneck but we can add 2 more 25Gbps ports per node creating 4 x 25Gbps LACP for SAN (is not the same that a 100Gbps port, but is near).
We are trying to know if Proxmox is able to hot plug NVMe discs, we know that hot plug is working properly with SAS SSD drives, and Dell has implemented PCIe hot plug in his hardware, but has been implemented PCIe hot plug in Proxmox kernel?
Thanks,
Xavier.