This may or may not be related, but try installing iperf3 on your openmediavault vm, on the proxmox host, and on one of your client machines.
Run iperf3 -s on your vm, then iperf3 -c vm.ip from the client and see if you are getting high retr. Run the iperf3 -s on your proxmox host and see if you...