I need help. My Main storage drive is full and I haven't been able to figure out how to use my second drive

warloxian

Member
Jun 26, 2021
47
0
11
58
I have ran out of storage space. I havce a second drive but I can't seem to figure out how to move or extend to the second drive so I can update and install ceph. My scans are listed below. Any help would be greatly appreciated
root@apple:~# pvscan
PV /dev/sdb1 VG vmdata lvm2 [<931.51 GiB / 851.35 GiB free]
PV /dev/sda3 VG pve lvm2 [<111.29 GiB / <8.82 GiB free]
Total: 2 [<1.02 TiB] / in use: 2 [<1.02 TiB] / in no VG: 0 [0 ]

root@apple:~# pvs
PV VG Fmt Attr PSize PFree
/dev/sda3 pve lvm2 a-- <111.29g <8.82g
/dev/sdb1 vmdata lvm2 a-- <931.51g 851.35g

root@apple:~# vgscan
Found volume group "vmdata" using metadata type lvm2
Found volume group "pve" using metadata type lvm2

root@apple:~# vgs
VG #PV #LV #SN Attr VSize VFree
pve 1 4 0 wz--n- <111.29g <8.82g
vmdata 1 1 0 wz--n- <931.51g 851.35g

root@apple:~# lvscan
ACTIVE '/dev/vmdata/vmstore' [80.00 GiB] inherit
ACTIVE '/dev/pve/swap' [8.00 GiB] inherit
ACTIVE '/dev/pve/root' [27.75 GiB] inherit
ACTIVE '/dev/pve/data' [59.66 GiB] inherit
ACTIVE '/dev/pve/storage' [300.00 GiB] inherit

root@apple:~# lvs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
data pve twi-aotz-- 59.66g 1.70 0.46
root pve -wi-ao---- 27.75g
storage pve Vwi-a-tz-- 300.00g data 0.34
swap pve -wi-ao---- 8.00g
vmstore vmdata twi-a-tz-- 80.00g 0.00 10.44

root@apple:~# blkid
/dev/sda2: UUID="017D-B84E" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="e38ddd86-9fb2-4172-ad51-8c4c790341b8"
/dev/sda3: UUID="cvvt34-Rw5Q-4WQK-AkQB-hVex-ZHJq-JiytgD" TYPE="LVM2_member" PARTUUID="5561e6b6-2c28-498b-b77f-c12c85d6c55b"
/dev/mapper/pve-swap: UUID="5a210943-3277-4f1f-913c-08c6d05ded2f" TYPE="swap"
/dev/mapper/pve-root: UUID="e41908ea-923c-48d5-b10a-ac3dbd62a240" BLOCK_SIZE="4096" TYPE="ext4"
/dev/sda1: PARTUUID="ed331ec6-fc12-4c51-9237-d26bc85bd760"
/dev/sdb1: UUID="MkaU0O-V0Jt-noiN-4glH-XcFu-fQhH-FqU9eN" TYPE="LVM2_member" PARTUUID="94182288-e5fd-46ea-b476-e44636bba39c"
/dev/mapper/pve-storage: UUID="0889cfe7-0ca6-440f-bb08-2de86372b9c1" BLOCK_SIZE="4096" TYPE="ext4"
 
Which volume do you want to extend? I'm assuming vmstore?
 
Can you just post the output of this command as well, so I can check the current size of your meta data pool? It would need to be extended as well. Please put the output in code tags.

Code:
lvs -a
 
Can you just post the output of this command as well, so I can check the current size of your meta data pool? It would need to be extended as well. Please put the output in code tags.

Code:
lvs -a
root@apple:~# lvs -a
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
data pve twi-aotz-- 59.66g 2.31 0.47
[data_tdata] pve Twi-ao---- 59.66g
[data_tmeta] pve ewi-ao---- <3.53g
[lvol0_pmspare] pve ewi------- <3.53g
root pve -wi-ao---- 27.75g
storage pve Vwi-aotz-- 300.00g data 0.46
swap pve -wi-ao---- 8.00g
[lvol0_pmspare] vmdata ewi------- 80.00m
vmstore vmdata twi-a-tz-- 80.00g 0.00 10.44
[vmstore_tdata] vmdata Twi-ao---- 80.00g
[vmstore_tmeta] vmdata ewi-ao---- 80.00m
 
You should be able to extend the pool like this (assuming you want to use the whole disk):

Code:
lvextend -L +1G /dev/vmdata/vmstore_tmeta
lvextend -l +100%FREE /dev/vmdata/vmstore
 
You should be able to extend the pool like this (assuming you want to use the whole disk):

Code:
lvextend -L +1G /dev/vmdata/vmstore_tmeta
lvextend -l +100%FREE /dev/vmdata/vmstore
So I ran the commands. Then I ran apt-get update && apt-get full-upgrade -y and I get this error. I am so sorry as I am still learning Linux and I can't express my thanks enough for your assistance with this issue


root@apple:~# lvextend -L +1G /dev/vmdata/vmstore_tmeta
Size of logical volume vmdata/vmstore_tmeta changed from 80.00 MiB (20 extents) to <1.08 GiB (276 extents).
Logical volume vmdata/vmstore_tmeta successfully resized.
root@apple:~# lvextend -l +100%FREE /dev/vmdata/vmstore
Size of logical volume vmdata/vmstore_tdata changed from 80.00 GiB (20480 extents) to 929.35 GiB (237914 extents).
Logical volume vmdata/vmstore_tdata successfully resized.

root@apple:~# apt-get update && apt-get full-upgrade -y
Get:1 http://security.debian.org bullseye-security InRelease [48.4 kB]
Err:1 http://security.debian.org bullseye-security InRelease
Error writing to file - write (28: No space left on device) [IP: 146.75.78.132 80]
Get:2 http://download.proxmox.com/debian/pve bullseye InRelease [2,661 B]
 
please be careful to post correctly.
output of terminal must be in a code tag because important informations are missing moreover posts without code tag it's too hard to read them.
output of "lvs -a" in a first code tag
then output of "df -h" in second code tag.
 
root@apple:~# lvextend -l +100%FREE /dev/vmdata/vmstore
Size of logical volume vmdata/vmstore_tdata changed from 80.00 GiB (20480 extents) to 929.35 GiB (237914 extents).
Logical volume vmdata/vmstore_tdata successfully resized.
...
root@apple:~# apt-get update && apt-get full-upgrade -y
apt writes its stuff to your root partition, not vmdata. what does
df /
show? you may need to clear up some stuff.
 
You guys are going to hate my guts, but I am a NEWBY . I have learned a lot about Linux in last year, but I have absolutely no programming experience and I am not sure how to add HTML tags to my post. I have spent the last year self teaching network security and I am just getting started on learning some Python programming. But when I look at what I posted, it looks exactly like what I am copying from my shell. I should have went to school for this because my self teaching methods are not well organized. Linux has been a rabbit hole for me. I start learning something and then find I need to learn something different to learn what I was working on. That keeps going and going and before you know it, I am on a completely different subject and have had to put my original goal at the end of the line. Anyone that's learned Linux on their own probably understands exactly what I am going through
 
Last edited:
apt writes its stuff to your root partition, not vmdata. what does
df /
show? you may need to clear up some stuff.
root@apple:~# df /
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/pve-root 28465204 27090668 0 100%
n't
This node is an older Apple with a 256g NVME and a TB hard drive. My ISO's are whats taking that space I can see that. If I could move my ISO's to the other drive? I would like to run a few VM's on this node if possible. My other 4 nodes are all servers. Point me in the right direction and I'll try to figure this out. When you guys hear from me it's when I am the end of my rope and haven't been able to find a working solution.
 
Last edited:
Yes, that is a problem with your root partition then. You still got some space left on that VG as well, though, so you could run the following commands to add the remaining space to root (~ 9 GB):

Code:
lvextend -l +100%FREE /dev/pve/root
resize2fs /dev/pve/root

You will really need to clean up some stuff on your root partition (/) afterward though. Furthermore, you can check space usage with ncdu (install via apt install ncdu).
 
Btw you can post stuff in code tags by clicking on the Symbol in the text editor that looks like this: </>
This makes it way easier to read the output, take this as an example:

without code tags:
total used free shared buff/cache available
Mem: 3.8Gi 1.7Gi 1.5Gi 48Mi 638Mi 1.9
Swap: 3.9Gi 0B 3.9Gi

with code tags:
Code:
               total        used        free      shared  buff/cache   available
Mem:           3.8Gi       1.7Gi       1.5Gi        48Mi       638Mi       1.9Gi
Swap:          3.9Gi          0B       3.9Gi
 
  • Like
Reactions: _gabriel

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!