/dev/mapper/pve-root is full

PmUserZFS

Well-Known Member
Feb 2, 2018
96
5
48
How can I solve the problem that /dev/mapper/pve-root is full? it prevents me from pulling docker containers.
Code:
/dev/mapper/pve-root    9.1G  8.6G   46M 100% /
Code:
--- /dev --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
   42.7 MiB [##########] /shm                                                                                                                                                                     
    0.0   B [          ] /char
    0.0   B [          ] /disk
    0.0   B [          ] /block
    0.0   B [          ] /input

--- /dev/shm ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
                         /..                                                                                                                                                                       
    1.0 MiB [##########]  qb-pve2-response-2257-31334-28-data
    1.0 MiB [##########]  qb-pve2-response-2257-31185-26-data
    1.0 MiB [##########]  qb-pve2-response-2257-31170-20-data
    1.0 MiB [##########]  qb-pve2-response-2257-30726-27-data
    1.0 MiB [##########]  qb-pve2-response-2257-2432-19-data
    1.0 MiB [##########]  qb-pve2-response-2257-2368-18-data
    1.0 MiB [##########]  qb-pve2-response-2257-2366-17-data
    1.0 MiB [##########]  qb-pve2-response-2257-2348-16-data
    1.0 MiB [##########]  qb-pve2-response-2257-2316-15-data
    1.0 MiB [##########]  qb-pve2-response-2257-2312-22-data
    1.0 MiB [##########]  qb-pve2-response-2257-2290-14-data
    1.0 MiB [##########]  qb-pve2-response-2257-2283-13-data
    1.0 MiB [##########]  qb-pve2-response-2257-19380-24-data
    1.0 MiB [##########]  qb-pve2-response-2257-10494-25-data
    1.0 MiB [##########]  qb-pve2-request-2257-31334-28-data
    1.0 MiB [##########]  qb-pve2-request-2257-31185-26-data
    1.0 MiB [##########]  qb-pve2-request-2257-31170-20-data
    1.0 MiB [##########]  qb-pve2-request-2257-30726-27-data
    1.0 MiB [##########]  qb-pve2-request-2257-2432-19-data
    1.0 MiB [##########]  qb-pve2-request-2257-2368-18-data
    1.0 MiB [##########]  qb-pve2-request-2257-2366-17-data
    1.0 MiB [##########]  qb-pve2-request-2257-2348-16-data
    1.0 MiB [##########]  qb-pve2-request-2257-2316-15-data
    1.0 MiB [##########]  qb-pve2-request-2257-2312-22-data
    1.0 MiB [##########]  qb-pve2-request-2257-2290-14-data
    1.0 MiB [##########]  qb-pve2-request-2257-2283-13-data
    1.0 MiB [##########]  qb-pve2-request-2257-19380-24-data
    1.0 MiB [##########]  qb-pve2-request-2257-10494-25-data
    1.0 MiB [##########]  qb-pve2-event-2257-31334-28-data
    1.0 MiB [##########]  qb-pve2-event-2257-31185-26-data
    1.0 MiB [##########]  qb-pve2-event-2257-31170-20-data
    1.0 MiB [##########]  qb-pve2-event-2257-30726-27-data
    1.0 MiB [##########]  qb-pve2-event-2257-2432-19-data
    1.0 MiB [##########]  qb-pve2-event-2257-2368-18-data
    1.0 MiB [##########]  qb-pve2-event-2257-2366-17-data
    1.0 MiB [##########]  qb-pve2-event-2257-2348-16-data
    1.0 MiB [##########]  qb-pve2-event-2257-2316-15-data
    1.0 MiB [##########]  qb-pve2-event-2257-2312-22-data
    1.0 MiB [##########]  qb-pve2-event-2257-2290-14-data
    1.0 MiB [##########]  qb-pve2-event-2257-2283-13-data
    1.0 MiB [##########]  qb-pve2-event-2257-19380-24-data
    1.0 MiB [##########]  qb-pve2-event-2257-10494-25-data
   12.0 KiB [          ]  qb-pve2-request-2257-31334-28-header
   12.0 KiB [          ]  qb-pve2-request-2257-31185-26-header


Code:
df -h
Filesystem              Size  Used Avail Use% Mounted on
udev                     32G     0   32G   0% /dev
tmpfs                   6.3G  678M  5.7G  11% /run
/dev/mapper/pve-root    9.1G  8.6G   45M 100% /
tmpfs                    32G   43M   32G   1% /dev/shm
tmpfs                   5.0M     0  5.0M   0% /run/lock
tmpfs                    32G     0   32G   0% /sys/fs/cgroup
data                    282G  2.7G  279G   1% /data
/dev/fuse                30M   16K   30M   1% /etc/pve
overlay                 9.1G  8.6G   45M 100% /var/lib/docker/overlay2/df563a93316f398c9b79febadc3e4d60e926f4f0a4f92bbc4b48038f634a065e/merged
shm                      64M     0   64M   0% /var/lib/docker/containers/076e79063d7a2d1c4eda015f5fc4f882c5ecc14039e44a5659d33933b9313394/shm
overlay                 9.1G  8.6G   45M 100% /var/lib/docker/overlay2/103bf36870f1f4088db8a52790b9892dd59ea400667dae2d03e165ae4d173095/merged
shm                      64M     0   64M   0% /var/lib/docker/containers/937a798e3fd1b864e620301f938522987fc6f8bf3807553d24f7e5c83d1297e7/shm
data/subvol-100-disk-1   16G  778M   16G   5% /data/subvol-100-disk-1
data/subvol-102-disk-1   16G  1.7G   15G  11% /data/subvol-102-disk-1
data/subvol-103-disk-1   32G  2.4G   30G   8% /data/subvol-103-disk-1
tank                    7.6T  128K  7.6T   1% /tank
tank/backup             8.0T  405G  7.6T   5% /tank/backup
tank/qbvolumes          7.6T  128K  7.6T   1% /tank/qbvolumes
tank/zones              7.6T  128K  7.6T   1% /tank/zones
tank/zones/qb0          7.7T   55G  7.6T   1% /tank/zones/qb0
tank/zones/test1        7.6T  492M  7.6T   1% /tank/zones/test1
tank/zones/uni0         7.6T  1.1G  7.6T   1% /tank/zones/uni1
data/subvol-104-disk-1   16G  956M   16G   6% /data/subvol-104-disk-1
data/subvol-106-disk-1   32G 1003M   32G   4% /data/subvol-106-disk-1
data/subvol-107-disk-1  8.0G  1.5G  6.6G  19% /data/subvol-107-disk-1
data/subvol-105-disk-1  8.0G  4.9G  3.2G  61% /data/subvol-105-disk-1
overlay                 9.1G  8.6G   45M 100% /var/lib/docker/overlay2/c13f25fbf84333133d51d4b410a1fa154d27d82bb49441b8ae6ad781b397c7f3/merged
shm                      64M     0   64M   0% /var/lib/docker/containers/c40c5c3ecb4c2316425b13373c65ad1753fa2ce9a4603f1f784b2ae981973ad5/shm
tmpfs                   6.3G     0  6.3G   0% /run/user/0
overlay                 9.1G  8.6G   45M 100% /var/lib/docker/overlay2/d94d0cc79b833968fd418c6f8b08a819fa3098ea66a9381ad68efd94685d9d53/merged
shm                      64M     0   64M   0% /var/lib/docker/containers/789b6a036c37de09c062442c9dff76d5fd3437f51a770c9b0ae6db6e4c64d6c6/shm

Code:
# <file system> <mount point> <type> <options> <dump> <pass>
/dev/pve/root / ext4 errors=remount-ro 0 1
/dev/pve/swap none swap sw 0 0
proc /proc proc defaults 0 0

how can I fix this?
 
Last edited:
check your root filesystem and delete not needed files.
 
Hm urk, my dockers are installed in /var/lib/docker thats bad. How can I move this directory without break it all?
 
No didnt help after I rebooted proxmox I can't start all lxc in proxmox

Code:
oot@pve:~# journalctl -xe
Feb 22 22:51:28 pve pveproxy[24658]: starting 1 worker(s)
Feb 22 22:51:28 pve pveproxy[24658]: worker 12515 started
Feb 22 22:51:28 pve pveproxy[12514]: Warning: unable to close filehandle GEN4 properly: No space left on device at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1572.
Feb 22 22:51:28 pve pveproxy[12514]: error writing access log
Feb 22 22:51:29 pve pveproxy[12514]: worker exit
Feb 22 22:51:29 pve pveproxy[24658]: worker 12514 finished
Feb 22 22:51:29 pve pveproxy[24658]: starting 1 worker(s)
Feb 22 22:51:29 pve pveproxy[24658]: worker 12516 started
Feb 22 22:51:29 pve pveproxy[12505]: Warning: unable to close filehandle GEN4 properly: No space left on device at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1572.
Feb 22 22:51:29 pve pveproxy[12505]: error writing access log
Feb 22 22:51:30 pve pveproxy[12505]: worker exit
Feb 22 22:51:30 pve pveproxy[24658]: worker 12505 finished
Feb 22 22:51:30 pve pveproxy[24658]: starting 1 worker(s)
Feb 22 22:51:30 pve pveproxy[24658]: worker 12517 started
Feb 22 22:51:30 pve pveproxy[12515]: Warning: unable to close filehandle GEN4 properly: No space left on device at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1572.
Feb 22 22:51:30 pve pveproxy[12515]: error writing access log