Greetings
I am experimenting with proxmox to see if it can be an alternative/replacement for vmware and so far I am impressed with the features and have one thing that is weird.
When I rsync a lot of files to a (ubuntu) vm with a disk that is formatted ZFS (single disk) the memory runs full in 5 minutes and the hypervisor reboots.
When the disk is formatted+added as LVM it works - I have now rsync'd 2 TB of data and no problems.
( I played around with rsync parameters, used SCP and CIFS (just to eliminate SSH) but either crashes proxmox when using rsync+zfs disk)
The problem seems either related to ZFS or ubuntu or rsync. (in that combination)
searching in the forums this indicates a cache overflow / not enough IOPS but I wonder if I can help trace this. Is this expected behavior?
So far I am not able to confirm the awesomeness of ZFS but then I am using a single disk in ZFS... no cache, just 8 GB of RAM (should be enough, no?)
If I can provide any traces / reproduce the problem le me know.
regards
Andreas
same happens with rsync over SSH - both directions (server-client (push) and client-server (pull))
I am experimenting with proxmox to see if it can be an alternative/replacement for vmware and so far I am impressed with the features and have one thing that is weird.
When I rsync a lot of files to a (ubuntu) vm with a disk that is formatted ZFS (single disk) the memory runs full in 5 minutes and the hypervisor reboots.
When the disk is formatted+added as LVM it works - I have now rsync'd 2 TB of data and no problems.
( I played around with rsync parameters, used SCP and CIFS (just to eliminate SSH) but either crashes proxmox when using rsync+zfs disk)
The problem seems either related to ZFS or ubuntu or rsync. (in that combination)
searching in the forums this indicates a cache overflow / not enough IOPS but I wonder if I can help trace this. Is this expected behavior?
So far I am not able to confirm the awesomeness of ZFS but then I am using a single disk in ZFS... no cache, just 8 GB of RAM (should be enough, no?)
If I can provide any traces / reproduce the problem le me know.
regards
Andreas
Dec 19 22:01:38 plex kernel: Key type cifs.idmap registered
Dec 19 22:01:38 plex kernel: CIFS: Attempting to mount //192.168.42.206/plex
Dec 19 22:01:38 plex kernel: No dialect specified on mount. Default has changed to a more secure dialect, SMB2.1 or>
>>> start rsync job <<<
Dec 19 22:02:50 plex Plex Media Server[768]: Connection to 82.94.168.38 closed by remote host.
Dec 19 22:05:34 plex PackageKit[1179]: daemon quit
Dec 19 22:05:34 plex systemd[1]: packagekit.service: Succeeded.
-- Reboot --
Dec 19 22:08:07 plex kernel: Linux version 5.4.0-58-generic (buildd@lcy01-amd64-004) (gcc version 9.3.0 (Ubuntu 9.3>
pported cpus:
same happens with rsync over SSH - both directions (server-client (push) and client-server (pull))