Hello. We are facing some problems with very poor CIFS performance.
Internet speed is 1Gbit/sec. We have cloud storage which is mounted to our pve cluster nodes.
Backup/Restore was very slow so we decided to do some tests
dd to cifs mounted storage shows around 6-8Mb/sec
Regular wget from pve nodes shows around 80-90Mb/sec
dd to lan NFS mounts - 120Mb/sec
disks are in raid 10
pveperf shows BUFFERED READS: 294.40 MB/sec
cifs mount options:
/storage/backup on /mnt/pve/backup type cifs (rw,relatime,vers=3.0,cache=strict,username=user,domain=,uid=0,noforceuid,gid=0,noforcegid,addr=x.x.x.x,file_mode=0755,dir_mode=0755,soft,nounix,serverino,mapposix,rsize=1048576,wsize=1048576,echo_interval=60,actimeo=1)
For testing purposes we installed proxmox on cloud server and mounted the same storage via cifs.
Doing the same dd test and result was around 130Mb/sec.
Its a bit confusing, because mounting options, internet speed and other parameters is identical
proxmox-ve: 5.3-1 (running kernel: 4.15.18-11-pve)
pve-manager: 5.3-9 (running version: 5.3-9/ba817b29)
pve-kernel-4.15: 5.3-2
pve-kernel-4.15.18-11-pve: 4.15.18-33
pve-kernel-4.4.134-1-pve: 4.4.134-112
pve-kernel-4.4.83-1-pve: 4.4.83-96
pve-kernel-4.4.35-1-pve: 4.4.35-77
corosync: 2.4.4-pve1
criu: 2.11.1-1~bpo90
glusterfs-client: 3.8.8-1
ksm-control-daemon: 1.2-2
libjs-extjs: 6.0.1-2
libpve-access-control: 5.1-3
libpve-apiclient-perl: 2.0-5
libpve-common-perl: 5.0-46
libpve-guest-common-perl: 2.0-20
libpve-http-server-perl: 2.0-11
libpve-storage-perl: 5.0-38
libqb0: 1.0.3-1~bpo9
lvm2: 2.02.168-pve6
lxc-pve: 3.1.0-3
lxcfs: 3.0.3-pve1
novnc-pve: 1.0.0-2
proxmox-widget-toolkit: 1.0-22
pve-cluster: 5.0-33
pve-container: 2.0-34
pve-docs: 5.3-2
pve-edk2-firmware: 1.20181023-1
pve-firewall: 3.0-17
pve-firmware: 2.0-6
pve-ha-manager: 2.0-6
pve-i18n: 1.0-9
pve-libspice-server1: 0.14.1-2
pve-qemu-kvm: 2.12.1-1
pve-xtermjs: 3.10.1-1
qemu-server: 5.0-46
smartmontools: 6.5+svn4324-1
spiceterm: 3.0-5
vncterm: 1.5-3
Any help would be appreciated
Internet speed is 1Gbit/sec. We have cloud storage which is mounted to our pve cluster nodes.
Backup/Restore was very slow so we decided to do some tests
dd to cifs mounted storage shows around 6-8Mb/sec
Regular wget from pve nodes shows around 80-90Mb/sec
dd to lan NFS mounts - 120Mb/sec
disks are in raid 10
pveperf shows BUFFERED READS: 294.40 MB/sec
cifs mount options:
/storage/backup on /mnt/pve/backup type cifs (rw,relatime,vers=3.0,cache=strict,username=user,domain=,uid=0,noforceuid,gid=0,noforcegid,addr=x.x.x.x,file_mode=0755,dir_mode=0755,soft,nounix,serverino,mapposix,rsize=1048576,wsize=1048576,echo_interval=60,actimeo=1)
For testing purposes we installed proxmox on cloud server and mounted the same storage via cifs.
Doing the same dd test and result was around 130Mb/sec.
Its a bit confusing, because mounting options, internet speed and other parameters is identical
proxmox-ve: 5.3-1 (running kernel: 4.15.18-11-pve)
pve-manager: 5.3-9 (running version: 5.3-9/ba817b29)
pve-kernel-4.15: 5.3-2
pve-kernel-4.15.18-11-pve: 4.15.18-33
pve-kernel-4.4.134-1-pve: 4.4.134-112
pve-kernel-4.4.83-1-pve: 4.4.83-96
pve-kernel-4.4.35-1-pve: 4.4.35-77
corosync: 2.4.4-pve1
criu: 2.11.1-1~bpo90
glusterfs-client: 3.8.8-1
ksm-control-daemon: 1.2-2
libjs-extjs: 6.0.1-2
libpve-access-control: 5.1-3
libpve-apiclient-perl: 2.0-5
libpve-common-perl: 5.0-46
libpve-guest-common-perl: 2.0-20
libpve-http-server-perl: 2.0-11
libpve-storage-perl: 5.0-38
libqb0: 1.0.3-1~bpo9
lvm2: 2.02.168-pve6
lxc-pve: 3.1.0-3
lxcfs: 3.0.3-pve1
novnc-pve: 1.0.0-2
proxmox-widget-toolkit: 1.0-22
pve-cluster: 5.0-33
pve-container: 2.0-34
pve-docs: 5.3-2
pve-edk2-firmware: 1.20181023-1
pve-firewall: 3.0-17
pve-firmware: 2.0-6
pve-ha-manager: 2.0-6
pve-i18n: 1.0-9
pve-libspice-server1: 0.14.1-2
pve-qemu-kvm: 2.12.1-1
pve-xtermjs: 3.10.1-1
qemu-server: 5.0-46
smartmontools: 6.5+svn4324-1
spiceterm: 3.0-5
vncterm: 1.5-3
Any help would be appreciated
Last edited: