Restores from VMware to Proxmox over Veeam locked at 3gbit/s

[dompro]

Hey,

we are currently testing restores from Veeam to Proxmox. Our Veeam repository has a disk speed of around 1gb/s and a 25g network connection.
The Proxmox Host also has 25g network and can write to the target disk (FC, lvm-thick) with 1gb/s.
When we restore a VMware machine to Proxmox we get pretty much exactly 375mb/s. (vmdk to qcow)
Restores of the same VM from the same repository to a VMware host with the same specs results in 900mb/s to 1gb/s.

Any way to get better results with Proxmox? Or is that to be expected because of the conversion?

thanks!

 

[dompro]

PS: A Proxmox Backup to Proxmox Restore is also locked at 3gbit/s

 

[dompro]

We asked a friendly company to do the same tests in their Proxmox infrastructure, and they are seeing the same limitations. Exactly 3gbit/s. They also upgraded to Veeam 13 and it stays the same. A Ticket at Veeam was answered with "We are not limiting anything, limitation is either on Proxmox side or from hardware".
Based on what I am seeing I would assume that Proxmox has a (non-configurable?) 3gbit/s limitation hidden somewhere.

 

[janus57]

Hi,

Are you restoring PVE backup to PVE ?
Or ESXI to PVE ?

As far as i know, PVE has no hardcoded limit speed.

Best regards,

 

[dompro]

Hi!

We tried both. In the ESXI to PVE restore we convert from vmdk to qcow. Which initially we thought could be the limiting factor. So we also tried to take a backup directly on PVE and restore to PVE.
But both restores have the same limitation, stuck at exactly 3gbit/s.

 

[janus57]

Hi,

Have you checked if the bottleneck is the veeam worker ?

Best regards,

 

[dompro]

Yes. With 6 Cores / 12GB RAM the worker is at 100% usage, both RAM and CPU. With 32 Cores and 128GB RAM the RAM usage was also at 100%, but the CPU usage only at 10%. It didn't change anything in the restore speed though.

 

[janus57]

Hi,

Veeam workers use the 25G NIC (i assume you have not only 25G network) ?
Network limit on the PVE port (switch level) ?

I don't have another clue since only veeam tech support can help to find the bottleneck on restore (for backup it's visible in the report).

Best regards,

 

[dompro]

Hi,

we tested with 2 hardware. First we tested with older hardware with 10G. Then we tested with a new hardware with 25G. Stays exactly the same. We also tested network throughput from Proxmox to Proxmox and from Proxmox to VMware. Around 9gbit on the 10G machines and around 20gbit on the 25G machine.

Update: We also connected a NFS NAS storage (around 800mb/s sequential) and the restore speed fluctuates a bit more, but also stays around 3gbit/s.