For some time I followed the "Verify Job" operation on our PBS and noticed that it takes a very long time, and the load is too low: "top" showed the use of only one processor core out of six. "iostat" showed no more than 40% disks activity. As I understand it, the check operation is performed in one thread. Is it possible to configure PBS to do "Verify Job" in the required number of threads by configuration or by the number of cores? If not, how to make a request to add such functionality? For example, so that PBS runs a verification for each archive as a separate task, but no more than a certain number, so as not to exceed the capabilities of the equipment?
Long time "Verify Job"
- Thread starter igor_ka
- Start date
StoreEasy 1650 has 16GB of memory. ZFS ARC zfs_arc_max parameter was set to 8GB. I've changed ZFS pool usage from ZFS file system to thin ZVOL + ext4. iostat's r_await are noticeably smaller: from 12-15 to 2-3. The throughput has increased by an order of magnitude from 6M/s to 60-100M/s and increased IOps (looked at zpool iostat). Garbage collection and data validation operations are now much faster. ZFS pool has 12x2TB HDD's in 2 VDEV's with 6 drives in each. ZFS had atime=off,recordsize=1M, primarycache=all, without L2ARC. ZVOL has volblocksize=64k. ext4 was formatted with parameters -b 4096 -E stride=16,stripe-width=192,nodiscard.
Last edited: