ext HDD configuration for docker proxmox

[nirok]

Hello, I can see these kind of questions have been asked before. but can't really determine the best way forward.

I havve proxmox installed on a small PC with NVME hdd. I have multiple containers running. I would like to add a single ext sata disk USB HDD 8TB and allow multiple docker containers to access it. Mostly for media storage that I dont care if i lose.

I created a ZFS volume with the single HDD and created a samba share via Cockpit. Mounted this on each LXC container. However it is super slow to add files to for some reason. I wonder what I am doing wrong.

• I dont care about redundnacy or backups
• would like reasonably fast read write to transfer large media files

Is ZFS best here, or shoudl I removve that and just create a directory and mount that using etx4

 

[news]

You use USB with, HDD over USB(2 or 3).

ZFS without 2nd HDD (ZFS VDEV as ZFS mirror) and
1) with 2x SSD SATA3 Partition-1 as ZFS mirror for ZFS special device,
2) no 2x SSD SATA3 Partition-2 as ZFS ZIL/SLOG.
3) And you can add on the same SSDs Partition-3 as ZFS stripe for ZFS cache (device).

That speed up the metadata and the file access.

Witch HDD do you use? I hope a NAS pro like with CMR storrage.

You must also change some settings on the ZFS Pool/ Dataset:
* zfs compression=on <zfs-pool>
* zfs atime=off <zfs-pool>

I hope setup a zfs dataset for your files like:
* zfs create <zfs-pool>/<zfs-dataset>
# man zfs create

if you "I dont care about redundnacy or backups", then of corse don't use Proxmox with ZFS on a single disk!

 

[nirok]

The sata DIsk HDD is just attached to the PC running proxmox. I am starting again so removed the ZFS partition for now. So now wonderign the best way forward to provide acess to this media storage HDD form multiple docker containers? Just add as ext4 directory?

 

[gfngfn256]

If all you need is media storage with no redundancy (it is one disk anyway!) don't do ZFS on a single external HDD.

Just add as ext4 directory?

Why not?

 

[Ernst T.]

Why not?

I don't know if it's important for @nirok or not. The USB-HDD will never go into standby/sleep mode, but will always be running.

 

[gfngfn256]

His question was how to add that external HDD to the Proxmox storage backend, either with ZFS or ext4 directory, I do not see how this impacts drive sleep/shutdown. If anything ZFS will have much more activity as opposed to simple ext4 directory storage.

But I must be honest, using a COW coupled with ZFS overhead on an external drive that requires no redundancy seems to be stupid in my books.

 

[nirok]

I don't know if it's important for @nirok or not. The USB-HDD will never go into standby/sleep mode, but will always be running.

Yes I was wondering about this. What the best way of doing this in terms of power usage. I do want my home setup to be low power. I currently have the ext sata drive in a caddy. Which is always powered on. Would it be different on a proper nas?

 

[nirok]

If all you need is media storage with no redundancy (it is one disk anyway!) don't do ZFS on a single external HDD.

Why not?

OK I have changed to ext4. Will see how I get on. Thanks!

 

[nirok]

I'm still very much confused about how to mount the drives to be honet and pass to an lxc with docker containers.

I have seen multiple YouTube guides. But everyone seem to do things differently and mostly ZFS/raid.

I am trying to use the internal nvme 500gb drive for promox, vms and docker container Configs. But can't quite work out how to to partition or mount like this.

Then I want to mount the external drive as a tank storage for the docker containers to use to store media etc.

I see lvm, lvm-thin and directory on my node. I've created a directory for my ext hdd for now is that correct? My docker Containers do see it and use it. Just not sure what is the best method.