IO delay

[DaveRR5]

Hi All

I'm using ZFS in raidz1 across 3 Samsung 860 qvo 2TB drives, they've been running pretty well for the past few months, however recently I've noticed a considerable slow down and quite high IO delay.

This is the first time I've used/tested ZFS & I'm unsure if everything is configured correctly. It's just a bit strange that all has been working fine until the past week or so. Can anyone help my troubleshoot/diagnose if there's a misconfiguration somewhere?

Also, not sure if it's a coincidence but I also have a 4TB seagate USB backup drive & run nightly backups of all VM's, normally getting 400MB+ a second transfer rate, this also had recently dropped to 9-10mb a second but randomly jumps to a faster rate and then falls again to 9mb/sec (see attached screenshots)

Thanks
Dave

 

[DaveRR5]

Can anyone help?

 

[elurex]

you might need to trim your sata ssd pool... but... beware of trimming shorten your ssd life... after trim you release more ssd space and it definately helps with performance, but on the other hand it will shorten your ssd life

 

[aaron]

Have you checked the SMART values of your disks? Node->Disks select a disk and click the Show SMART values button on top.

 

[DaveRR5]

Here's a screen shot of each drive, look okay to me

 

[DaveRR5]

Anyone?

 

[DaveRR5]

pveperf

CPU BOGOMIPS: 175613.40

REGEX/SECOND: 1810763

HD SIZE: 2760.67 GB (rpool/ROOT/pve-1)

FSYNCS/SECOND: 4.53

DNS EXT: 48.66 ms

DNS INT: 492.80 ms

 

[LnxBil]

but... beware of trimming shorten your ssd life... after trim you release more ssd space and it definately helps with performance, but on the other hand it will shorten your ssd life

Where have you read this? All resources (including SSD vendors) on the internet say otherwise.

 

[LnxBil]

Anyone?

Have you trimmed as @elurex said?

FSYNCS/SECOND: 4.53

This is EXTREMELY slow. I've never seen soo low values.

Can you provide some statistics with iostat and zpool iostat?