Help finding the right configuration

barto_95

New Member
Dec 15, 2022
8
0
1
We need to replace our supermicro server with vmware with a new machine... we would like to switch to proxmox with the backup system when changing our physical server (starting to get old)

Currently we have vmware servers with 48 core (hyperthreath) and 128gb of ram, but only 600G Raid1 (600+600) of SSD (for some vm we use an NFS datastore on synology)
I would like to have more storage but I understand that it is not necessary to do hardware RAID with proxmox.

The problem currently is that we have migrations which take a lot of time when we switch the vm from one server to another and even more time if the datastore of the vm is on the synology (we only have for information on 1g cards which I think also poses a problem during migration speed)

Because we have to recommend hardware to replace the existing one, I would like to implement a solution that will allow all my VMs to be on the disks of the server itself and if necessary to do a manual migration or by HA that be fast
so in terms of storage I would potentially need SSD but I am also thinking of NVME for SQL type virtual machines or even zabbix to have rapid grafana request returns when we ask for statistics over several days

one of my questions is to know by reading on the different topics of the forum, it is not advisable to install proxmox on satadom but rather on small disks but to secure this part it would be necessary to have proxmox on an ssd in raid at case where one of the two SSD drives fails ?
is it necessary to have a hardware raid which faces believing in proxmox that there is only one disk to install the OS or during the installation proxmox can make sure to use two SSDs to install on the OS level ?

another question I saw internally that some people strongly advised against using NVME disks to do full virtual machines because the VME (dies) over time of use

I also need to do backups and the installation of these servers would be done on two datacenters separated physically but connected with real black fiber
the latency between the two is around 1.2/1.5ms between the two datacenters

the backup part would be done by PBS in vm mode but which would store on a synology NAS in HA full SSD


Thank you for your response and dsl for my English I use an online translator (google translate :p )
 
it would be necessary to have proxmox on an ssd in raid at case where one of the two SSD drives fails ?
If you care about downtime, yes.
All configurations are stored there, even the ones needed for the VMs. On the other disks will only be the virtual disks.
And there is no official way yet to backup/restore a PVE host nor to export/import configs.

is it necessary to have a hardware raid which faces believing in proxmox that there is only one disk to install the OS or during the installation proxmox can make sure to use two SSDs to install on the OS level ?
You can create a software raid1 using ZFS/btrfs when installing PVE. But make sure to not have to connected to a HW raid controller when doing this (or switch it to HBA/IT-mode) and to use CMR HDDs or enterprise grade SSDs.


another question I saw internally that some people strongly advised against using NVME disks to do full virtual machines because the VME (dies) over time of use
Its not against NVMe SSDs. Its against consumer SSDs. Buy nothing without a power-loss protection and with proper DWPD and you should be fine. This is the case for all SATA, SAS, M.2, U.2, ... SSDs. You will find tons of good U.2/U.3 enterprise NVMe SSDs but only a handful of M.2 enterprise SSDs and those M.2 SSDs tend to overheat andare quite limited in capacity because of the limited form factor.
 
Last edited:
48 core (hyperthreath) and 128gb of ram
Who advices that? In my experience, RAM is much more important than cores. Therefore we always go with GHz over cores and put in plents of RAM. If you do not have any CPU intensive application, less cores will yield a much faster system.

Because we have to recommend hardware to replace the existing one, I would like to implement a solution that will allow all my VMs to be on the disks of the server itself and if necessary to do a manual migration or by HA that be fast
share-nothing migrations are always very, very slow in comparison to a shared storage. I recommend to have a dedicated or distributes shared storage to have fast migration times (only ram necessary) and HA-possible.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!