Unknown directories - Proxmox with ZFS

Hello Proxmox Members,
I've been using Proxmox for some time and now looked through my snapshots list and wondered about some entries. The entries are located under "/rpool/ROOT/pve-1/" and then a hash. Here is my listing of the datasets:

Code:
NAME                                                                                               USED  AVAIL     REFER  MOUNTPOINT
rpool                                                                                              575G  1.19T      208K  /rpool
rpool/ROOT                                                                                         574G  1.19T      192K  /rpool/ROOT
rpool/ROOT/pve-1                                                                                   574G  1.19T      558G  /
rpool/ROOT/pve-1/00687e366e483e44071dd947916cb85c40dfc68f1a2196716f58dee777a88fc6                    1M  1.19T     79.4M  legacy
rpool/ROOT/pve-1/00687e366e483e44071dd947916cb85c40dfc68f1a2196716f58dee777a88fc6@673275434         16K      -     79.4M  -
rpool/ROOT/pve-1/00e0c796924bfb769ada0b8b472adeaa5e10215050416cbeed82d52ec1ad0f4c                  192K  1.19T     9.91M  legacy
rpool/ROOT/pve-1/bd95bcd0f5c7526d5325aa24e49eb0f9cc142f2d921767945c23d52aa5ecbb4a@220233566         16K      -     40.5M  -
rpool/ROOT/pve-1/be732cfb83272715e58edd6d6370e5b78401714647ad9bad6772abf39037315c                 4.04M  1.19T     4.02M  legacy
rpool/ROOT/pve-1/be732cfb83272715e58edd6d6370e5b78401714647ad9bad6772abf39037315c@176971775         16K      -     4.02M  -
rpool/ROOT/pve-1/bf31160c98d0dd09e0314c81193b64ce4200030ccc5ffdd347106a9e5e27525d                 6.63M  1.19T     49.9M  legacy
rpool/ROOT/pve-1/bf31160c98d0dd09e0314c81193b64ce4200030ccc5ffdd347106a9e5e27525d@160434339         16K      -     49.9M  -
rpool/ROOT/pve-1/bf8dd494c5e9806eae01e3187cb69e18c78f9f60549b05bb6240d5f0ab26cf49                 3.57M  1.19T     40.6M  legacy
rpool/ROOT/pve-1/bf8dd494c5e9806eae01e3187cb69e18c78f9f60549b05bb6240d5f0ab26cf49@312970389         16K      -     40.6M  -
rpool/ROOT/pve-1/bff48276299120621841ad2f1c803b721f31073a0f8002b724310fc61c7db76d                 1.67G  1.19T     1.74G  legacy
rpool/ROOT/pve-1/c18dcc616e12edf9efc315863b010cadb094953ce6125bccb5638fc47a00a528                  952K  1.19T     41.6M  legacy
rpool/ROOT/pve-1/c18dcc616e12edf9efc315863b010cadb094953ce6125bccb5638fc47a00a528@99575174          16K      -     41.6M  -
rpool/ROOT/pve-1/c1a81dfdac00eb34c4e32a53cdb5e2bbe12d6ca60abe4f9b63201e947af4fcc0                 5.37M  1.19T     5.35M  legacy
rpool/ROOT/pve-1/c1a81dfdac00eb34c4e32a53cdb5e2bbe12d6ca60abe4f9b63201e947af4fcc0@654584036         16K      -     5.35M  -
rpool/ROOT/pve-1/c212f28570cbd77e000195f4d3af40a21f4b28861c5fb045491ec1ed3649d746                  208K  1.19T     40.6M  legacy
rpool/ROOT/pve-1/c212f28570cbd77e000195f4d3af40a21f4b28861c5fb045491ec1ed3649d746@667820553         16K      -     40.6M  -
rpool/ROOT/pve-1/c25fe000514621e365848655e7e4dd2589fc12aa17229e5138afa48008915ebc                 51.0M  1.19T     89.7M  legacy
rpool/ROOT/pve-1/c9534f639cb2ba571e13c4a38512c533c008d8351fe1c96aa1d4096f4ccdf433                 23.8M  1.19T     79.4M  legacy
rpool/ROOT/pve-1/c9534f639cb2ba571e13c4a38512c533c008d8351fe1c96aa1d4096f4ccdf433@148999482         16K      -     79.4M  -
rpool/ROOT/pve-1/cb1b669a37ea92846c920cb3fef1fc162837b24124d5380fa13f791da37cb95c                  304K  1.19T      148M  legacy
rpool/ROOT/pve-1/cb1b669a37ea92846c920cb3fef1fc162837b24124d5380fa13f791da37cb95c@437153072         16K      -      148M  -
rpool/ROOT/pve-1/cb70c72f44455f717ae17b5c324a3a8a28eea402f8134a314223b11572cfae2a                 47.0M  1.19T     85.8M  legacy
rpool/ROOT/pve-1/cc4f05d43c86329390a9526bb122ad8dfceb39ea724a0b86a4fa80daed30d27c                  208K  1.19T     40.6M  legacy
rpool/ROOT/pve-1/cc4f05d43c86329390a9526bb122ad8dfceb39ea724a0b86a4fa80daed30d27c@107588948         16K      -     40.6M  -
rpool/ROOT/pve-1/ce08702f55a39c1ea847bddd4ffdf373384a3130f2f882e691be6440db5642b1                 2.49M  1.19T     44.2M  legacy
rpool/ROOT/pve-1/ce08702f55a39c1ea847bddd4ffdf373384a3130f2f882e691be6440db5642b1@870645679          0B      -     44.2M  -
rpool/ROOT/pve-1/ce8b1059af0f700d424b4ba83ff74fe917ac7f887d5c34dae23cd37b7299d878                  264K  1.19T     40.6M  legacy
rpool/ROOT/pve-1/ce8b1059af0f700d424b4ba83ff74fe917ac7f887d5c34dae23cd37b7299d878@170563713         16K      -     40.6M  -
rpool/ROOT/pve-1/d004d1a8f5fa20ee6dfdf9fbf25547955ccd5311103c41a8406af468772b9b77                  264K  1.19T     40.6M  legacy
rpool/ROOT/pve-1/d004d1a8f5fa20ee6dfdf9fbf25547955ccd5311103c41a8406af468772b9b77@416738839         16K      -     40.6M  -
rpool/ROOT/pve-1/d005174c99e4ccc294390f3b224ff2c742693b788e83d7679ed6872ea673fb60                  130M  1.19T      136M  legacy
rpool/ROOT/pve-1/d005174c99e4ccc294390f3b224ff2c742693b788e83d7679ed6872ea673fb60@457578824         16K      -      136M  -
rpool/ROOT/pve-1/d090a3329dfb462879f0a31e545952d95dc647a1a402f50d54e8c262e4db7719                 6.48M  1.19T     6.70M  legacy
rpool/ROOT/pve-1/d090a3329dfb462879f0a31e545952d95dc647a1a402f50d54e8c262e4db7719@971384419         16K      -     6.70M  -
rpool/ROOT/pve-1/d092bb0b86709ca1f7003f2b6c045cb2fa793ef4c9cfccd4786b92396ed45529                 1.66G  1.19T     1.74G  legacy
rpool/ROOT/pve-1/d2d946db28cbcf1bb2d9c0bdf584514b0fabd1ccd99ed70aac33202d0caf44a6                 12.8M  1.19T     22.6M  legacy
rpool/ROOT/pve-1/d3418c8b5bf53886afae4f485c13c2cb8ea3171a2c3b7f750a45e05c37c0a6ba                 45.1M  1.19T     83.8M  legacy
rpool/ROOT/pve-1/d362bfe19ddb061b3ec5f6a430bf05fdb600ce07d7d6b8e7eebffc0cefdf6d77                  144K  1.19T     15.1M  legacy
rpool/ROOT/pve-1/d362bfe19ddb061b3ec5f6a430bf05fdb600ce07d7d6b8e7eebffc0cefdf6d77-init             240K  1.19T     15.1M  legacy
rpool/ROOT/pve-1/d362bfe19ddb061b3ec5f6a430bf05fdb600ce07d7d6b8e7eebffc0cefdf6d77-init@653358598    16K      -     15.1M  -
rpool/ROOT/pve-1/d41efd6dea38c7d8eaa010f17135f848e3442319967a1a0e0fd5c7314bcb661a                 6.92M  1.19T     50.7M  legacy
rpool/ROOT/pve-1/d41efd6dea38c7d8eaa010f17135f848e3442319967a1a0e0fd5c7314bcb661a@346191678          0B      -     50.7M  -
rpool/ROOT/pve-1/d45f834f0896483d0530b9c8889567cccf8e597ef649a060ab7eff136aad2813                  952K  1.19T     41.6M  legacy
rpool/ROOT/pve-1/d45f834f0896483d0530b9c8889567cccf8e597ef649a060ab7eff136aad2813@544058385         16K      -     41.6M  -
rpool/ROOT/pve-1/d590aea7d06b9141d44edd3b193deca825fe6239f556f9ff85f887b99b67f213                  112K  1.19T     24.4M  legacy
rpool/ROOT/pve-1/d590aea7d06b9141d44edd3b193deca825fe6239f556f9ff85f887b99b67f213-init             240K  1.19T     24.4M  legacy
rpool/ROOT/pve-1/d590aea7d06b9141d44edd3b193deca825fe6239f556f9ff85f887b99b67f213-init@940809134    16K      -     24.4M  -
rpool/ROOT/pve-1/d61d77d3423288b3a2f9ec85cdf0762c2702808b8331059be20ce1e6b54cd70d                 6.63M  1.19T     50.0M  legacy
rpool/ROOT/pve-1/d61d77d3423288b3a2f9ec85cdf0762c2702808b8331059be20ce1e6b54cd70d@225013049         16K      -     50.0M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f                 8.76M  1.19T     37.2M  legacy
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@687125377          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@774167964          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@683893533          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@682626665          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@522431780          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@585153276          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@428662620          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@579163076          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@677132140          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@978539045          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@622303508          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@431509737          0B      -     37.2M  -
rpool/ROOT/pve-1/d843b4b447c2692cd6d497d0d98d7b2f6c9b37948538de49fa0364e35cdf501f@394738827          0B      -     37.2M  -
rpool/ROOT/pve-1/d8c5a32b0a409b26a29209d26d41296660e829643857afa01f8d96709549b0ab                 3.52M  1.19T     40.5M  legacy
rpool/ROOT/pve-1/d8c5a32b0a409b26a29209d26d41296660e829643857afa01f8d96709549b0ab@622349709         16K      -     40.5M  -
rpool/ROOT/pve-1/fef435d7771a5e798da438c6e5e27b90845f005a401fafc52c5c7add24e42742                  216K  1.19T     79.4M  legacy
rpool/ROOT/pve-1/fef435d7771a5e798da438c6e5e27b90845f005a401fafc52c5c7add24e42742@948738028         16K      -     79.4M  -
rpool/ROOT/pve-1/ff1d080c9e6692e2896176b74242af6cb10d57f4962a0fdcb120100ad3d775a8                 5.32M  1.19T     9.90M  legacy
rpool/ROOT/pve-1/ff1d080c9e6692e2896176b74242af6cb10d57f4962a0fdcb120100ad3d775a8@950694445         16K      -     9.90M  -
rpool/ROOT/pve-1/ff29b77bb09c071baaa11acdad96fa25c07a860233505d73b7fc9743d8f510e4                 2.44M  1.19T     43.8M  legacy
rpool/ROOT/pve-1/ff29b77bb09c071baaa11acdad96fa25c07a860233505d73b7fc9743d8f510e4@194820037         16K      -     43.8M  -
rpool/ROOT/pve-1/ffc92dce6db02f6b3783e8f32f271878275706674d23df7c071da89f5011e5d8                 2.59M  1.19T     6.41M  legacy
rpool/ROOT/pve-1/ffc92dce6db02f6b3783e8f32f271878275706674d23df7c071da89f5011e5d8@211662359         16K      -     6.41M  -
rpool/ROOT/pve-1/fffebc20c54f54328abd2ce5b2323b47de900b400e9bfd1b718eecbb7829d1be                  184K  1.19T     23.1M  legacy
rpool/ROOT/pve-1/fffebc20c54f54328abd2ce5b2323b47de900b400e9bfd1b718eecbb7829d1be@427860079         16K      -     23.1M  -
rpool/data                                                                                         580M  1.19T      192K  /rpool/data

The list is even longer but I could not post it because of the forum limitations. So my question is what are these datasets for? Also how can I see the stored data? When I navigate to the path then there is no folder there.
 
I have the same issue and I'm not sure what these are for.

I mounted one (zfs set mountpoint=/rpool/test-mount rpool/ROOT/pve-1/0f4da397e0138d328fc376e071ae697606f13b6fdc2117d3d93d01d685f5743a) and it seems to be a full filesystem of sorts. I wonder if it's used for Proxmox upgrades? I'm not sure if I need it anymore.

Here are mine, minus the snapshots:

Code:
NAME                                                                                             USED  AVAIL     REFER  MOUNTPOINT
rpool                                                                                           77.8G   137G       96K  /rpool
rpool/ROOT                                                                                      14.1G   137G       96K  /rpool/ROOT
rpool/ROOT/pve-1                                                                                14.1G   137G     13.3G  /
rpool/ROOT/pve-1/0f4da397e0138d328fc376e071ae697606f13b6fdc2117d3d93d01d685f5743a               50.5M   137G     50.4M  legacy
rpool/ROOT/pve-1/0uarnvr87782g2bjvjfrwq90y                                                      2.67M   137G        6M  legacy
rpool/ROOT/pve-1/3yzmzhjzij46phmp2vx6mznra                                                      1.78M   137G     7.59M  legacy
rpool/ROOT/pve-1/4421b3f9730b8ec7777e8c45610fdb0928c932b3dfff242006a153075de5b32a               4.37M   137G     4.37M  legacy
rpool/ROOT/pve-1/6b8qurmllnvt3elpof02sm2lf                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/7eyq567xc3ajahgzvswiy010u                                                        92K   137G      203M  legacy
rpool/ROOT/pve-1/8u6e8220gldmikr6z1zpoqquj                                                        96K   137G       96K  legacy
rpool/ROOT/pve-1/9a48463f0ae459ef88a1c2a1c45376cde04f0f3aa000f17386d137657363cfab               4.41M   137G     4.35M  legacy
rpool/ROOT/pve-1/9f39c27beaf9b8405af022b90f53878a2ada8ac78b59793c0b386fc4906a411f               47.6M   137G     47.6M  legacy
rpool/ROOT/pve-1/9vpx7rn9a4okwtsph12udrkv9                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/a0foohh8m7bz1yi893bzb5tk8                                                       154M   137G      203M  legacy
rpool/ROOT/pve-1/accd2f5373d8f67c5347be428a1953673776b81adc6082af581186a9d6011f59                 96K   137G       96K  legacy
rpool/ROOT/pve-1/eymonfckakdpcyebp9k6j4vyp                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/f026s8dfmffczisnugdrevx7u                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/g6sxjc4mmsmbabva99rjfisk3                                                        96K   137G       96K  legacy
rpool/ROOT/pve-1/icwzmwsbhy42ddk4nlcfqyd82                                                        96K   137G       96K  legacy
rpool/ROOT/pve-1/j4ucqz2u3rqvlp1u9w833qv2n                                                       100K   137G      100K  legacy
rpool/ROOT/pve-1/mo2t52ns6qmfxa1rsyhdqcv6n                                                       128K   137G     7.59M  legacy
rpool/ROOT/pve-1/pf1fwhj5v651dh1wxj1nlmsrq                                                        96K   137G       96K  legacy
rpool/ROOT/pve-1/sb8bz44fkvqwqej3vcbo13okm                                                      8.29M   137G     11.6M  legacy
rpool/ROOT/pve-1/yw5faatmqep209b9gbqsa1ijx                                                       112K   137G     11.6M  legacy
 
Last edited:
no, PVE will neither create snapshots for the root dataset, nor automatically create sub-datasets like that out of the box. I suggest taking a peak inside to see what they contain (and evaluate any third-party software/scripts you have installed that might cause their creation)..
 
Yes, it's the docker layers for containers. You should have created a separate dataset and mount it to /var/lib/docker before installing Docker on the ZFS PVE host. Then, everything docker related would be under that dataset.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!