Unknown directories - Proxmox with ZFS

T

Tim Hörnle - UJAM

Member
Proxmox Subscriber
Jul 26, 2021
15
2
8
30
www.ujam.com
Hello Proxmox Members,
I've been using Proxmox for some time and now looked through my snapshots list and wondered about some entries. The entries are located under "/rpool/ROOT/pve-1/" and then a hash. Here is my listing of the datasets:

Code: 
NAME                                                                                               USED  AVAIL     REFER  MOUNTPOINT
rpool                                                                                              575G  1.19T      208K  /rpool
rpool/ROOT                                                                                         574G  1.19T      192K  /rpool/ROOT
rpool/ROOT/pve-1                                                                                   574G  1.19T      558G  /
rpool/ROOT/pve-1/00687e366e483e44071dd947916cb85c40dfc68f1a2196716f58dee777a88fc6                    1M  1.19T     79.4M  legacy
rpool/ROOT/pve-1/00687e366e483e44071dd947916cb85c40dfc68f1a2196716f58dee777a88fc6@673275434         16K      -     79.4M  -
rpool/ROOT/pve-1/00e0c796924bfb769ada0b8b472adeaa5e10215050416cbeed82d52ec1ad0f4c                  192K  1.19T     9.91M  legacy
rpool/ROOT/pve-1/bd95bcd0f5c7526d5325aa24e49eb0f9cc142f2d921767945c23d52aa5ecbb4a@220233566         16K      -     40.5M  -
rpool/ROOT/pve-1/be732cfb83272715e58edd6d6370e5b78401714647ad9bad6772abf39037315c                 4.04M  1.19T     4.02M  legacy
rpool/ROOT/pve-1/be732cfb83272715e58edd6d6370e5b78401714647ad9bad6772abf39037315c@176971775         16K      -     4.02M  -
rpool/ROOT/pve-1/bf31160c98d0dd09e0314c81193b64ce4200030ccc5ffdd347106a9e5e27525d                 6.63M  1.19T     49.9M  legacy
rpool/ROOT/pve-1/bf31160c98d0dd09e0314c81193b64ce4200030ccc5ffdd347106a9e5e27525d@160434339         16K      -     49.9M  -
rpool/ROOT/pve-1/bf8dd494c5e9806eae01e3187cb69e18c78f9f60549b05bb6240d5f0ab26cf49                 3.57M  1.19T     40.6M  legacy
rpool/ROOT/pve-1/bf8dd494c5e9806eae01e3187cb69e18c78f9f60549b05bb6240d5f0ab26cf49@312970389         16K      -     40.6M  -
rpool/ROOT/pve-1/bff48276299120621841ad2f1c803b721f31073a0f8002b724310fc61c7db76d                 1.67G  1.19T     1.74G  legacy
rpool/ROOT/pve-1/c18dcc616e12edf9efc315863b010cadb094953ce6125bccb5638fc47a00a528                  952K  1.19T     41.6M  legacy
rpool/ROOT/pve-1/c18dcc616e12edf9efc315863b010cadb094953ce6125bccb5638fc47a00a528@99575174          16K      -     41.6M  -
rpool/ROOT/pve-1/c1a81dfdac00eb34c4e32a53cdb5e2bbe12d6ca60abe4f9b63201e947af4fcc0                 5.37M  1.19T     5.35M  legacy
rpool/ROOT/pve-1/c1a81dfdac00eb34c4e32a53cdb5e2bbe12d6ca60abe4f9b63201e947af4fcc0@654584036         16K      -     5.35M  -
rpool/ROOT/pve-1/c212f28570cbd77e000195f4d3af40a21f4b28861c5fb045491ec1ed3649d746                  208K  1.19T     40.6M  legacy
rpool/ROOT/pve-1/c212f28570cbd77e000195f4d3af40a21f4b28861c5fb045491ec1ed3649d746@667820553         16K      -     40.6M  -
rpool/ROOT/pve-1/c25fe000514621e365848655e7e4dd2589fc12aa17229e5138afa48008915ebc                 51.0M  1.19T     89.7M  legacy
rpool/ROOT/pve-1/c9534f639cb2ba571e13c4a38512c533c008d8351fe1c96aa1d4096f4ccdf433                 23.8M  1.19T     79.4M  legacy
rpool/ROOT/pve-1/c9534f639cb2ba571e13c4a38512c533c008d8351fe1c96aa1d4096f4ccdf433@148999482         16K      -     79.4M  -
rpool/ROOT/pve-1/cb1b669a37ea92846c920cb3fef1fc162837b24124d5380fa13f791da37cb95c                  304K  1.19T      148M  legacy
rpool/ROOT/pve-1/cb1b669a37ea92846c920cb3fef1fc162837b24124d5380fa13f791da37cb95c@437153072         16K      -      148M  -
rpool/ROOT/pve-1/cb70c72f44455f717ae17b5c324a3a8a28eea402f8134a314223b11572cfae2a                 47.0M  1.19T     85.8M  legacy
rpool/ROOT/pve-1/cc4f05d43c86329390a9526bb122ad8dfceb39ea724a0b86a4fa80daed30d27c                  208K  1.19T     40.6M  legacy
rpool/ROOT/pve-1/cc4f05d43c86329390a9526bb122ad8dfceb39ea724a0b86a4fa80daed30d27c@107588948         16K      -     40.6M  -
rpool/ROOT/pve-1/ce08702f55a39c1ea847bddd4ffdf373384a3130f2f882e691be6440db5642b1                 2.49M  1.19T     44.2M  legacy
rpool/ROOT/pve-1/ce08702f55a39c1ea847bddd4ffdf373384a3130f2f882e691be6440db5642b1@870645679          0B      -     44.2M  -
rpool/ROOT/pve-1/ce8b1059af0f700d424b4ba83ff74fe917ac7f887d5c34dae23cd37b7299d878                  264K  1.19T     40.6M  legacy
rpool/ROOT/pve-1/ce8b1059af0f700d424b4ba83ff74fe917ac7f887d5c34dae23cd37b7299d878@170563713         16K      -     40.6M  -
rpool/ROOT/pve-1/d004d1a8f5fa20ee6dfdf9fbf25547955ccd5311103c41a8406af468772b9b77                  264K  1.19T     40.6M  legacy
rpool/ROOT/pve-1/d004d1a8f5fa20ee6dfdf9fbf25547955ccd5311103c41a8406af468772b9b77@416738839         16K      -     40.6M  -
rpool/ROOT/pve-1/d005174c99e4ccc294390f3b224ff2c742693b788e83d7679ed6872ea673fb60                  130M  1.19T      136M  legacy
rpool/ROOT/pve-1/d005174c99e4ccc294390f3b224ff2c742693b788e83d7679ed6872ea673fb60@457578824         16K      -      136M  -
rpool/ROOT/pve-1/d090a3329dfb462879f0a31e545952d95dc647a1a402f50d54e8c262e4db7719                 6.48M  1.19T     6.70M  legacy
rpool/ROOT/pve-1/d090a3329dfb462879f0a31e545952d95dc647a1a402f50d54e8c262e4db7719@971384419         16K      -     6.70M  -
rpool/ROOT/pve-1/d092bb0b86709ca1f7003f2b6c045cb2fa793ef4c9cfccd4786b92396ed45529                 1.66G  1.19T     1.74G  legacy
rpool/ROOT/pve-1/d2d946db28cbcf1bb2d9c0bdf584514b0fabd1ccd99ed70aac33202d0caf44a6                 12.8M  1.19T     22.6M  legacy
rpool/ROOT/pve-1/d3418c8b5bf53886afae4f485c13c2cb8ea3171a2c3b7f750a45e05c37c0a6ba                 45.1M  1.19T     83.8M  legacy
rpool/ROOT/pve-1/d362bfe19ddb061b3ec5f6a430bf05fdb600ce07d7d6b8e7eebffc0cefdf6d77                  144K  1.19T     15.1M  legacy
rpool/ROOT/pve-1/d362bfe19ddb061b3ec5f6a430bf05fdb600ce07d7d6b8e7eebffc0cefdf6d77-init             240K  1.19T     15.1M  legacy
rpool/ROOT/pve-1/d362bfe19ddb061b3ec5f6a430bf05fdb600ce07d7d6b8e7eebffc0cefdf6d77-init@653358598    16K      -     15.1M  -
rpool/ROOT/pve-1/d41efd6dea38c7d8eaa010f17135f848e3442319967a1a0e0fd5c7314bcb661a                 6.92M  1.19T     50.7M  legacy
rpool/ROOT/pve-1/d41efd6dea38c7d8eaa010f17135f848e3442319967a1a0e0fd5c7314bcb661a@346191678          0B      -     50.7M  -
rpool/ROOT/pve-1/d45f834f0896483d0530b9c8889567cccf8e597ef649a060ab7eff136aad2813                  952K  1.19T     41.6M  legacy
rpool/ROOT/pve-1/d45f834f0896483d0530b9c8889567cccf8e597ef649a060ab7eff136aad2813@544058385         16K      -     41.6M  -
rpool/ROOT/pve-1/d590aea7d06b9141d44edd3b193deca825fe6239f556f9ff85f887b99b67f213                  112K  1.19T     24.4M  legacy
rpool/ROOT/pve-1/d590aea7d06b9141d44edd3b193deca825fe6239f556f9ff85f887b99b67f213-init             240K  1.19T     24.4M  legacy
rpool/ROOT/pve-1/d590aea7d06b9141d44edd3b193deca825fe6239f556f9ff85f887b99b67f213-init@940809134    16K      -     24.4M  -
rpool/ROOT/pve-1/d61d77d3423288b3a2f9ec85cdf0762c2702808b8331059be20ce1e6b54cd70d                 6.63M  1.19T     50.0M  legacy
rpool/ROOT/pve-1/d61d77d3423288b3a2f9ec85cdf0762c2702808b8331059be20ce1e6b54cd70d@225013049         16K      -     50.0M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f                 8.76M  1.19T     37.2M  legacy
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@687125377          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@774167964          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@683893533          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@682626665          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@522431780          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@585153276          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@428662620          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@579163076          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@677132140          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@978539045          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@622303508          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@431509737          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@394738827          0B      -     37.2M  -
rpool/ROOT/pve-1/d8c5a32b0a409b26a29209d26d41296660e829643857afa01f8d96709549b0ab                 3.52M  1.19T     40.5M  legacy
rpool/ROOT/pve-1/d8c5a32b0a409b26a29209d26d41296660e829643857afa01f8d96709549b0ab@622349709         16K      -     40.5M  -
rpool/ROOT/pve-1/fef435d7771a5e798da438c6e5e27b90845f005a401fafc52c5c7add24e42742                  216K  1.19T     79.4M  legacy
rpool/ROOT/pve-1/fef435d7771a5e798da438c6e5e27b90845f005a401fafc52c5c7add24e42742@948738028         16K      -     79.4M  -
rpool/ROOT/pve-1/ff1d080c9e6692e2896176b74242af6cb10d57f4962a0fdcb120100ad3d775a8                 5.32M  1.19T     9.90M  legacy
rpool/ROOT/pve-1/ff1d080c9e6692e2896176b74242af6cb10d57f4962a0fdcb120100ad3d775a8@950694445         16K      -     9.90M  -
rpool/ROOT/pve-1/ff29b77bb09c071baaa11acdad96fa25c07a860233505d73b7fc9743d8f510e4                 2.44M  1.19T     43.8M  legacy
rpool/ROOT/pve-1/ff29b77bb09c071baaa11acdad96fa25c07a860233505d73b7fc9743d8f510e4@194820037         16K      -     43.8M  -
rpool/ROOT/pve-1/ffc92dce6db02f6b3783e8f32f271878275706674d23df7c071da89f5011e5d8                 2.59M  1.19T     6.41M  legacy
rpool/ROOT/pve-1/ffc92dce6db02f6b3783e8f32f271878275706674d23df7c071da89f5011e5d8@211662359         16K      -     6.41M  -
rpool/ROOT/pve-1/fffebc20c54f54328abd2ce5b2323b47de900b400e9bfd1b718eecbb7829d1be                  184K  1.19T     23.1M  legacy
rpool/ROOT/pve-1/fffebc20c54f54328abd2ce5b2323b47de900b400e9bfd1b718eecbb7829d1be@427860079         16K      -     23.1M  -
rpool/data                                                                                         580M  1.19T      192K  /rpool/data

The list is even longer but I could not post it because of the forum limitations. So my question is what are these datasets for? Also how can I see the stored data? When I navigate to the path then there is no folder there.
 
I have the same issue and I'm not sure what these are for.

I mounted one (zfs set mountpoint=/rpool/test-mount rpool/ROOT/pve-1/0f4da397e0138d328fc376e071ae697606f13b6fdc2117d3d93d01d685f5743a) and it seems to be a full filesystem of sorts. I wonder if it's used for Proxmox upgrades? I'm not sure if I need it anymore.

Here are mine, minus the snapshots:

Code: 
NAME                                                                                             USED  AVAIL     REFER  MOUNTPOINT
rpool                                                                                           77.8G   137G       96K  /rpool
rpool/ROOT                                                                                      14.1G   137G       96K  /rpool/ROOT
rpool/ROOT/pve-1                                                                                14.1G   137G     13.3G  /
rpool/ROOT/pve-1/0f4da397e0138d328fc376e071ae697606f13b6fdc2117d3d93d01d685f5743a               50.5M   137G     50.4M  legacy
rpool/ROOT/pve-1/0uarnvr87782g2bjvjfrwq90y                                                      2.67M   137G        6M  legacy
rpool/ROOT/pve-1/3yzmzhjzij46phmp2vx6mznra                                                      1.78M   137G     7.59M  legacy
rpool/ROOT/pve-1/4421b3f9730b8ec7777e8c45610fdb0928c932b3dfff242006a153075de5b32a               4.37M   137G     4.37M  legacy
rpool/ROOT/pve-1/6b8qurmllnvt3elpof02sm2lf                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/7eyq567xc3ajahgzvswiy010u                                                        92K   137G      203M  legacy
rpool/ROOT/pve-1/8u6e8220gldmikr6z1zpoqquj                                                        96K   137G       96K  legacy
rpool/ROOT/pve-1/9a48463f0ae459ef88a1c2a1c45376cde04f0f3aa000f17386d137657363cfab               4.41M   137G     4.35M  legacy
rpool/ROOT/pve-1/9f39c27beaf9b8405af022b90f53878a2ada8ac78b59793c0b386fc4906a411f               47.6M   137G     47.6M  legacy
rpool/ROOT/pve-1/9vpx7rn9a4okwtsph12udrkv9                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/a0foohh8m7bz1yi893bzb5tk8                                                       154M   137G      203M  legacy
rpool/ROOT/pve-1/accd2f5373d8f67c5347be428a1953673776b81adc6082af581186a9d6011f59                 96K   137G       96K  legacy
rpool/ROOT/pve-1/eymonfckakdpcyebp9k6j4vyp                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/f026s8dfmffczisnugdrevx7u                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/g6sxjc4mmsmbabva99rjfisk3                                                        96K   137G       96K  legacy
rpool/ROOT/pve-1/icwzmwsbhy42ddk4nlcfqyd82                                                        96K   137G       96K  legacy
rpool/ROOT/pve-1/j4ucqz2u3rqvlp1u9w833qv2n                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/mo2t52ns6qmfxa1rsyhdqcv6n                                                       128K   137G     7.59M  legacy
rpool/ROOT/pve-1/pf1fwhj5v651dh1wxj1nlmsrq                                                        96K   137G       96K  legacy
rpool/ROOT/pve-1/sb8bz44fkvqwqej3vcbo13okm                                                      8.29M   137G     11.6M  legacy
rpool/ROOT/pve-1/yw5faatmqep209b9gbqsa1ijx                                                       112K   137G     11.6M  legacy
 
Last edited:
no, PVE will neither create snapshots for the root dataset, nor automatically create sub-datasets like that out of the box. I suggest taking a peak inside to see what they contain (and evaluate any third-party software/scripts you have installed that might cause their creation)..
 
Yes, it's the docker layers for containers. You should have created a separate dataset and mount it to /var/lib/docker before installing Docker on the ZFS PVE host. Then, everything docker related would be under that dataset.
 
You must log in or register to reply here.
Top Bottom