ZFS Server crash

Alessandro Paoni

New Member
Feb 4, 2017
5
0
1
54
I installed a new server, the motherboard is a Supermicro X10SRL-F with Intel C612, the installed CPU is Intel Xeon E5-2620V4 8core HT, 2X16GB ram DDR4 ECC Reg, 4x4TB eagate Costellation SATA disks.
Configuration software, Proxmox VE 4.4-1, the disks are mirrored ZFS-vdevs there are 2 running VM, first is a Linux mail server with 4GB 4core and 2 Virtio discs, the second is a Windows 2008R2 16Gb, 4 discs .
The server is now in both VS test environment have been restored from an old backup diu Proxmox.
The problem is that when Windows server copies a large amount of data with large files crashes and restarts, it happened 6 times in 2 days, 2 times the entire server and 'rebooted. The problem occurs either by copying data with the network or locally.
I tried to play some music in the IDE configuration, SATA virtio but nothing changed.
Any ideas?
 
I installed a new server, the motherboard is a Supermicro X10SRL-F with Intel C612, the installed CPU is Intel Xeon E5-2620V4 8core HT, 2X16GB ram DDR4 ECC Reg, 4x4TB eagate Costellation SATA disks.
Configuration software, Proxmox VE 4.4-1, the disks are mirrored ZFS-vdevs there are 2 running VM, first is a Linux mail server with 4GB 4core and 2 Virtio discs, the second is a Windows 2008R2 16Gb, 4 discs .
The server is now in both VS test environment have been restored from an old backup diu Proxmox.
The problem is that when Windows server copies a large amount of data with large files crashes and restarts, it happened 6 times in 2 days, 2 times the entire server and 'rebooted. The problem occurs either by copying data with the network or locally.
I tried to play some music in the IDE configuration, SATA virtio but nothing changed.
Any ideas?

you allocate 24GB out of your 32GB of RAM to VMs, which only leaves 8GB for ZFS. by default, ZFS will limit its own cache to half the available memory (16GB in this case), so you probably experience a situation of ZFS not releasing memory fast enough, and running into swapping which can lead to instability (especially if swap is on ZFS).

you can either put more memory into the box (recommended), limit the VM memory and/or limit the ARC
 
It's not accettable I have to use half of my memory to mantain disk system, I will install hardware raid.
Thank you
Hi you can simply reduce the mem for zfs (zfs_arc_max): http://pve.proxmox.com/wiki/ZFS:_Tips_and_Tricks
Be sure to run "update-initramfs -u" before reboot if your root-filesystem is zfs also.

I had an temp-system with 8GB which has same effect than yours and with the right settings it's run stable.

Udo