Proxmox ZFS pool: recurring disk access

Dec 6, 2021
8
0
6
40
Hi,

I recently have set up a new Proxmox installation. The installation itself together with all VMs/containers are running from a SSD. Aditionally I have a ZFS mirror managed by Proxmox acting as a network storage. And for some reason the disks produce a disk access noise every 5 seconds. I googled and I found several things which might cause this (zfs sync etc) but so far I was not able to get rid of it. Also monitoring iotop doesn't show me an obvious cause. The weird thing is that I only noticed the noise after switching from actually way louder Seagate Exos drives to much quieter WD Reds. For some reason the Exos disks didn't seem to produce this noise even though they were way louder during access than the Reds. The noise isn't very loud but since the server is in my living room, it still bothers me. I am already thinking about changing the filesystem of the datastore to ext4 or btrfs since it is only used as a network share.

Does anyone here have some more ideas?
 
With ZFS async writes are first written to RAM and by default every 5 seconds (txg timeout) the data will be written from RAM to disk. But it should only do that when there is data that needs to be written, so you should check whats actually writing to your pool all the time. If you for example add a CIFS share to proxmox, proxmox will access that share every several seconds to check if the share is still available. And if you don't disabled the "atime" attribute ZFS will do a write for every read to update the atime metadata.
So first I would disabale the pools atime if your services don't rely on it (PBS for example does), so not every time a process reads a cached file in the ARC will cause an additional write operation.
 
Last edited:
I came here for the same reason. I have 8x2.5" drives as a ZFS pool and noticed it doing the same thing. Only when I shut down a few VE running does it stop the drives surging. There is no data being created or accessed just the VE sitting at idle. Any ideas why this is happening? IT will shorten the life of my drives and I would like to solve this issue.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!