[SOLVED] What is the best zfs-compression for videofiles?

[fireon]

Hello,

i have some videofiles that I've record with my linuxvdr. So i created a new dataset (lzo) an saved this there. But there are no compression. The movies are all in TS rawformat. So it is possible to get some compression with zfs? Or is that a problem with videos in this format?

pve-manager/5.1-51/96be5354 (running kernel: 4.10.17-5-pve)

Thanks

 

[dcsapak]

normally ts files are mpeg2 encoded which already compresses lossy, so any further (non-video-aware) compression will not be good

 

[fireon]

Ok... i understand. So, would you say it make sense to disable compression for this dataset completely?

 

[dcsapak]

Ok... i understand. So, would you say it make sense to disable compression for this dataset completely?

if you really only have video files there, sure but i think the cpu time consumed is not so high that it would change much, and if you also write non-video data there, it might actually compress to some degree

 

[fireon]

Yes it make sense too, there are also some Artworks... Ok, so then I let everything go that way.
Last questions: Can i do some optimization with the blocksize. I've never been busy with that. But I've read that for big files sometimes you can get better performance with a different block size.

Thanks a lot

 

[dcsapak]

according to http://open-zfs.org/wiki/Performance_tuning it could be tuned to the application
but this depends... i would test for my workload and decide then

 

[fireon]

Thank you very much.

 

[alexskysilk]

generally enabling lz4 on a zfs volume is fairly safe even for media files since its pretty good at detection of non compressible files. If the data is going to be all media files, its wise to just disable compression.