new servers on AMD Genoa (4th Gen AMD EPYC)

[frhack]

Hi,
I'm planning to buy two servers in order to host two Proxmox VE with local storage replicated between the two.
I need to enter in production in the first quarter of 2023.

HW specs follow.

This is very new hardware, platform, and if I'm correct, still not supported by Proxmox.
When this architecture will be fully supported by Proxmox ?

thanks

Francesco

---

Server
- Server HPE ProLiant DL325 Gen11
- CPU AMD EPYC 9354P 2,85 GHz 32 core
- RAM DDR5 128GB minimum / 256 GB optimal

Storage OS
- n.3 (2+1 spare) HPE 800 GB NVMe Gen4 High Performance Mixed Use SFF with power loss protection
Example Kioxia CD6 800 GB mixed use / HPE P25948-B21

Storage VM
- n.5 (4+1 spare) HPE 1,600 GB NVMe Gen4 High Performance Mixed Use SFF with power loss protection
Example Kioxia CD6 1,600 GB mixed use / HPE P20195-B21


Networking per replica
10GbE 2-port SFP+ Network Adapter (PCIe/OCP)

Networking LAN
10GbE 2-port SFP+ Network Adapter (PCIe/OCP)

 

[LnxBil]

When this architecture will be fully supported by Proxmox ?

When the underlying Ubuntu LTS kernel supports it. This is not in the handy of the Proxmox Staff.

 

[frhack]

When the underlying Ubuntu LTS kernel supports it. This is not in the handy of the Proxmox Staff.

thanks

It seems that Ubuntu 22.04 LTS already support AMD EPYC Gen 4th:

https://www.club386.com/amd-epyc-9654-genoa-review-different-dimension-performance/

https://www.tomshardware.com/review...cores-zen-4-and-5nm-disrupt-the-data-center/4

 

[jsterr]

This 10Gbit network could be easily replaced with a 25/40/100 Gbit for the zfs replication sync (direct cabling). Dont forget the Quorum device (3 votes needed)

 

[frhack]

This 10Gbit network could be easily replaced with a 25/40/100 Gbit for the zfs replication sync (direct cabling). Dont forget the Quorum device (3 votes needed)

Thanks alot !
the two server are in two distinct seat at 250 meter distance, can I still use direct cabling ?

The Quorum device is needed for automatic migration ?

Will be there also a Proxmox backup server, that I suppose will be connected in the "replica network"

 

[jsterr]

Thanks alot !
the two server are in two distinct seat at 250 meter distance, can I still use direct cabling ?

The Quorum device is needed for automatic migration ?

25Gbit: OM3 70m, OM4 100m
40GBit: OM3 100m, OM4 150m
100GBit: OM3 100m, OM4 150m

but those seem to be outdated: it is also important to check your transceivers: https://www.fs.com/de/products/167796.html for example has 300m reach with MMF 100G on OM4.

 

[frhack]

25Gbit: OM3 70m, OM4 100m
40GBit: OM3 100m, OM4 150m
100GBit: OM3 100m, OM4 150m

but those seem to be outdated: it is also important to check your transceivers: https://www.fs.com/de/products/167796.html for example has 300m reach with MMF 100G on OM4.

thanks

Will be there also a Proxmox backup server, that I suppose will be connected in the "replica network"
Correct ?

 

[jsterr]

thanks

Will be there also a Proxmox backup server, that I suppose will be connected in the "replica network"
Correct ?

I mean if your direct connect two nodes theres no room for another node - but you could also add switches in this setup. another possible way could be to setup a meshed network between the two worker nodes and the pbs - but I havent tested this -- we currently only use meshed setups for ceph. https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server

You could also configure your pbs as a external quorum (qdevice) for your 2 cluster nodes: https://pve.proxmox.com/wiki/Cluster_Manager#_corosync_external_vote_support