Extended my root pve - bad idea

VenimK

New Member
May 26, 2025
2
0
1
i started with a nvme drive 250gb
then kinda learning how it all works.

Some time later, i added a standard hdd 4TB, and accidently added that to my pve/root
now i would like to remove that again, allready moved every container to my NAS

reading on howto that, i allways end up with dev/sda is in use

any info here

lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
loop0 7:0 0 200G 0 loop
loop1 7:1 0 4G 0 loop
loop2 7:2 0 20G 0 loop
loop3 7:3 0 2G 0 loop
loop4 7:4 0 10G 0 loop
sda 8:0 0 3.6T 0 disk
└─pve-root 252:1 0 3.9T 0 lvm /
sdb 8:16 1 7.6G 0 disk
├─sdb1 8:17 1 270K 0 part
├─sdb2 8:18 1 8M 0 part
├─sdb3 8:19 1 1.5G 0 part
└─sdb4 8:20 1 300K 0 part
nvme0n1 259:0 0 931.5G 0 disk
└─nvme0n1p1 259:1 0 931.5G 0 part /mnt/models
nvme1n1 259:2 0 238.5G 0 disk
├─nvme1n1p1 259:3 0 1007K 0 part
├─nvme1n1p2 259:4 0 1G 0 part /boot/efi
└─nvme1n1p3 259:5 0 237.5G 0 part
├─pve-swap 252:0 0 8G 0 lvm [SWAP]
└─pve-root 252:1 0 3.9T 0 lvm /


lvs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
root pve -wi-ao---- 3.86t
swap pve -wi-ao---- 8.00g
root@pve:~# lvdisplay /dev/pve/root
--- Logical volume ---
LV Path /dev/pve/root
LV Name root
VG Name pve
LV UUID 1deLmi-bcq2-rKBp-ejlz-8Ebd-6Ac4-xdF95f
LV Write Access read/write
LV Creation host, time proxmox, 2025-06-04 16:22:35 +0200
LV Status available
# open 1
LV Size 3.86 TiB
Current LE 1012606
Segments 2
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 252:1

root@pve:~# lvdisplay
--- Logical volume ---
LV Path /dev/pve/swap
LV Name swap
VG Name pve
LV UUID 3v00yU-qEEN-HHOh-f25H-hrCT-CJ8q-7xfqIn
LV Write Access read/write
LV Creation host, time proxmox, 2025-06-04 16:22:35 +0200
LV Status available
# open 1
LV Size 8.00 GiB
Current LE 2048
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 252:0

--- Logical volume ---
LV Path /dev/pve/root
LV Name root
VG Name pve
LV UUID 1deLmi-bcq2-rKBp-ejlz-8Ebd-6Ac4-xdF95f
LV Write Access read/write
LV Creation host, time proxmox, 2025-06-04 16:22:35 +0200
LV Status available
# open 1
LV Size 3.86 TiB
Current LE 1012606
Segments 2
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 252:1

Guess new install ?????
 
Hi @VenimK , welcome to the forum.

If you don't have important information, or, are able to back it up properly - your fastest solution may be to reinstall. That said, even if you want to avoid reinstall - back your system up and make sure the backup is good.

You indicated that you concatenated the disk (sda) to existing PVE group which was based on an NVMe disk.
However, you did not show the composition of the group, only the Logical Volumes. There are layers to the system that exist before the LVs:
vgs
pvs
vgs -o +devices
lvdisplay -m pve/root

You may need to remove any LVs to free up the space, as to remove your disk you need to migrate the data off of it:
pvmove /dev/sda

Followed by removing the device from the VGs:
vgreduce pve /dev/sda

These are high level commands, there may be other commands/reports needed between the steps. If you don't feel comfortable with the procedure - go ahead and wipe your system.

PS
Also, since your root volume is spanned across disks and appears to contain more than 400GB of data, you will not be able to move it off the sda - there is simply no space.

Again, please realize the above steps are very high level without deep look at your system. Reducing disk, volume and file system sizes always comes with risk.


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
Last edited:
this is is with all the command you provided


vgs
VG #PV #LV #SN Attr VSize VFree
pve 2 2 0 wz--n- 3.87t 0


pvs
PV VG Fmt Attr PSize PFree
/dev/nvme1n1p3 pve lvm2 a-- 237.47g 0
/dev/sda pve lvm2 a-- <3.64t 0

vgs -o +devices
VG #PV #LV #SN Attr VSize VFree Devices
pve 2 2 0 wz--n- 3.87t 0 /dev/nvme1n1p3(0)
pve 2 2 0 wz--n- 3.87t 0 /dev/nvme1n1p3(2048)
pve 2 2 0 wz--n- 3.87t 0 /dev/sda(0)


lvdisplay -m pve/root
--- Logical volume ---
LV Path /dev/pve/root
LV Name root
VG Name pve
LV UUID 1deLmi-bcq2-rKBp-ejlz-8Ebd-6Ac4-xdF95f
LV Write Access read/write
LV Creation host, time proxmox, 2025-06-04 16:22:35 +0200
LV Status available
# open 1
LV Size 3.86 TiB
Current LE 1012606
Segments 2
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 252:1
--- Segments ---
Logical extents 0 to 58744:
Type linear
Physical volume /dev/nvme1n1p3
Physical extents 2048 to 60792
Logical extents 58745 to 1012605:
Type linear
Physical volume /dev/sda
Physical extents 0 to 953860

now every lxc container is moved to nas storage ....