Hello,
After numerous attempts and reading a lot of posts here etc, pretty stuck now. I am wondering how to configure the 2nd nvm to allow me to migrate VM's between the cluster to the 2nd NVM.
Setup
Server 1 (existing)
1x SSD, partitioned: root and thin-pool LVM
edit- actually this now has a second thin pool configured on it, by accident.
Server 2 (new)
1st 500GB NVM, partition: root and thin-pool LVM
2nd 2TB NVM, partition: LVM
I found this post: https://forum.proxmox.com/threads/h...emove-the-lvm-thin-from-previous-disk.110770/
---> May be comment #5, is what I am looking for?
I am wondering if it is a limitation of the pool names, as I can move VM/CT between the servers which are in the:
ID = local-lvm
VG = pve
thin pool = data
Once the VM/CT is migrated I can then move the storage location on the VM/CT to the new NVM. A little clunky for my liking.
I am not looking to extend ie lvextend this to include the new 2TB NVM, as I believe this will just extend the pool over the 2 disks.
I also noticed a post that mentioned vgextend, but not familiar with this also,
Some of the current file setup
lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 1.8T 0 disk
└─sda1 8:1 0 1.8T 0 part
sdb 8:16 0 1.8T 0 disk
└─sdb1 8:17 0 1.8T 0 part
sdc 8:32 0 5.5T 0 disk
└─sdc1 8:33 0 5.5T 0 part
nvme0n1 259:0 0 465.8G 0 disk
├─nvme0n1p1 259:1 0 1007K 0 part
├─nvme0n1p2 259:2 0 1G 0 part /boot/efi
└─nvme0n1p3 259:3 0 464.8G 0 part
├─pve-swap 252:0 0 8G 0 lvm [SWAP]
├─pve-root 252:1 0 65G 0 lvm /
├─pve-data_tmeta 252:2 0 3.8G 0 lvm
│ └─pve-data-tpool 252:4 0 368.2G 0 lvm
│ ├─pve-data 252:5 0 368.2G 1 lvm
│ ├─pve-vm--100--disk--1 252:6 0 40G 0 lvm
│ └─pve-vm--100--disk--0 252:10 0 40G 0 lvm
├─pve-data_tdata 252:3 0 368.2G 0 lvm
│ └─pve-data-tpool 252:4 0 368.2G 0 lvm
│ ├─pve-data 252:5 0 368.2G 1 lvm
│ ├─pve-vm--100--disk--1 252:6 0 40G 0 lvm
│ └─pve-vm--100--disk--0 252:10 0 40G 0 lvm
├─pve-nvm2_tmeta 252:7 0 16M 0 lvm
│ └─pve-nvm2 252:9 0 15.8G 0 lvm
└─pve-nvm2_tdata 252:8 0 15.8G 0 lvm
└─pve-nvm2 252:9 0 15.8G 0 lvm
nvme1n1 259:4 0 1.8T 0 disk
└─nvme1n1p1 259:5 0 1.8T 0 part
├─nvme2tb-nvme2tb_tmeta 252:11 0 15.9G 0 lvm
│ └─nvme2tb-nvme2tb-tpool 252:13 0 1.8T 0 lvm
│ ├─nvme2tb-nvme2tb 252:14 0 1.8T 1 lvm
│ └─nvme2tb-vm--101--disk--0 252:15 0 15G 0 lvm
└─nvme2tb-nvme2tb_tdata 252:12 0 1.8T 0 lvm
└─nvme2tb-nvme2tb-tpool 252:13 0 1.8T 0 lvm
├─nvme2tb-nvme2tb 252:14 0 1.8T 1 lvm
└─nvme2tb-vm--101--disk--0 252:15 0 15G 0 lvm
root@pve-pumpkin:~# vgdisplay
--- Volume group ---
VG Name nvme2tb
System ID
Format lvm2
Metadata Areas 1
Metadata Sequence No 6
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 2
Open LV 1
Max PV 0
Cur PV 1
Act PV 1
VG Size <1.82 TiB
PE Size 4.00 MiB
Total PE 476931
Alloc PE / Size 476837 / <1.82 TiB
Free PE / Size 94 / 376.00 MiB
VG UUID ZG6sIl-7pjV-JsGg-MKwd-lVKT-DqGj-KssKRb
--- Volume group ---
VG Name pve
System ID
Format lvm2
Metadata Areas 1
Metadata Sequence No 22
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 6
Open LV 2
Max PV 0
Cur PV 1
Act PV 1
VG Size <464.76 GiB
PE Size 4.00 MiB
Total PE 118978
Alloc PE / Size 118941 / 464.61 GiB
Free PE / Size 37 / 148.00 MiB
VG UUID njZZ73-mq4Y-F2x1-36ZQ-m225-8JdZ-Y1gIyu
lvs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
nvme2tb nvme2tb twi-aotz-- <1.79t 0.09 0.15
vm-101-disk-0 nvme2tb Vwi-aotz-- 15.00g nvme2tb 10.67
data pve twi-aotz-- <368.25g 0.18 0.47
nvm2 pve twi-a-tz-- 15.84g 0.00 10.57
root pve -wi-ao---- 65.00g
swap pve -wi-ao---- 8.00g
vm-100-disk-0 pve Vwi-a-tz-- 40.00g data 0.02
vm-100-disk-1 pve Vwi-a-tz-- 40.00g data 1.62
cat /etc/pve/storage.cfg
dir: local
path /var/lib/vz
content iso,backup,vztmpl
lvmthin: local-lvm
thinpool data
vgname pve
content images,rootdir
lvmthin: nvm2
thinpool nvm2
vgname pve
content images,rootdir
lvmthin: nvme2tb
thinpool nvme2tb
vgname nvme2tb
content images,rootdir
After numerous attempts and reading a lot of posts here etc, pretty stuck now. I am wondering how to configure the 2nd nvm to allow me to migrate VM's between the cluster to the 2nd NVM.
Setup
Server 1 (existing)
1x SSD, partitioned: root and thin-pool LVM
edit- actually this now has a second thin pool configured on it, by accident.
Server 2 (new)
1st 500GB NVM, partition: root and thin-pool LVM
2nd 2TB NVM, partition: LVM
I found this post: https://forum.proxmox.com/threads/h...emove-the-lvm-thin-from-previous-disk.110770/
---> May be comment #5, is what I am looking for?
I am wondering if it is a limitation of the pool names, as I can move VM/CT between the servers which are in the:
ID = local-lvm
VG = pve
thin pool = data
Once the VM/CT is migrated I can then move the storage location on the VM/CT to the new NVM. A little clunky for my liking.
I am not looking to extend ie lvextend this to include the new 2TB NVM, as I believe this will just extend the pool over the 2 disks.
I also noticed a post that mentioned vgextend, but not familiar with this also,
Some of the current file setup
lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 1.8T 0 disk
└─sda1 8:1 0 1.8T 0 part
sdb 8:16 0 1.8T 0 disk
└─sdb1 8:17 0 1.8T 0 part
sdc 8:32 0 5.5T 0 disk
└─sdc1 8:33 0 5.5T 0 part
nvme0n1 259:0 0 465.8G 0 disk
├─nvme0n1p1 259:1 0 1007K 0 part
├─nvme0n1p2 259:2 0 1G 0 part /boot/efi
└─nvme0n1p3 259:3 0 464.8G 0 part
├─pve-swap 252:0 0 8G 0 lvm [SWAP]
├─pve-root 252:1 0 65G 0 lvm /
├─pve-data_tmeta 252:2 0 3.8G 0 lvm
│ └─pve-data-tpool 252:4 0 368.2G 0 lvm
│ ├─pve-data 252:5 0 368.2G 1 lvm
│ ├─pve-vm--100--disk--1 252:6 0 40G 0 lvm
│ └─pve-vm--100--disk--0 252:10 0 40G 0 lvm
├─pve-data_tdata 252:3 0 368.2G 0 lvm
│ └─pve-data-tpool 252:4 0 368.2G 0 lvm
│ ├─pve-data 252:5 0 368.2G 1 lvm
│ ├─pve-vm--100--disk--1 252:6 0 40G 0 lvm
│ └─pve-vm--100--disk--0 252:10 0 40G 0 lvm
├─pve-nvm2_tmeta 252:7 0 16M 0 lvm
│ └─pve-nvm2 252:9 0 15.8G 0 lvm
└─pve-nvm2_tdata 252:8 0 15.8G 0 lvm
└─pve-nvm2 252:9 0 15.8G 0 lvm
nvme1n1 259:4 0 1.8T 0 disk
└─nvme1n1p1 259:5 0 1.8T 0 part
├─nvme2tb-nvme2tb_tmeta 252:11 0 15.9G 0 lvm
│ └─nvme2tb-nvme2tb-tpool 252:13 0 1.8T 0 lvm
│ ├─nvme2tb-nvme2tb 252:14 0 1.8T 1 lvm
│ └─nvme2tb-vm--101--disk--0 252:15 0 15G 0 lvm
└─nvme2tb-nvme2tb_tdata 252:12 0 1.8T 0 lvm
└─nvme2tb-nvme2tb-tpool 252:13 0 1.8T 0 lvm
├─nvme2tb-nvme2tb 252:14 0 1.8T 1 lvm
└─nvme2tb-vm--101--disk--0 252:15 0 15G 0 lvm
root@pve-pumpkin:~# vgdisplay
--- Volume group ---
VG Name nvme2tb
System ID
Format lvm2
Metadata Areas 1
Metadata Sequence No 6
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 2
Open LV 1
Max PV 0
Cur PV 1
Act PV 1
VG Size <1.82 TiB
PE Size 4.00 MiB
Total PE 476931
Alloc PE / Size 476837 / <1.82 TiB
Free PE / Size 94 / 376.00 MiB
VG UUID ZG6sIl-7pjV-JsGg-MKwd-lVKT-DqGj-KssKRb
--- Volume group ---
VG Name pve
System ID
Format lvm2
Metadata Areas 1
Metadata Sequence No 22
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 6
Open LV 2
Max PV 0
Cur PV 1
Act PV 1
VG Size <464.76 GiB
PE Size 4.00 MiB
Total PE 118978
Alloc PE / Size 118941 / 464.61 GiB
Free PE / Size 37 / 148.00 MiB
VG UUID njZZ73-mq4Y-F2x1-36ZQ-m225-8JdZ-Y1gIyu
lvs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
nvme2tb nvme2tb twi-aotz-- <1.79t 0.09 0.15
vm-101-disk-0 nvme2tb Vwi-aotz-- 15.00g nvme2tb 10.67
data pve twi-aotz-- <368.25g 0.18 0.47
nvm2 pve twi-a-tz-- 15.84g 0.00 10.57
root pve -wi-ao---- 65.00g
swap pve -wi-ao---- 8.00g
vm-100-disk-0 pve Vwi-a-tz-- 40.00g data 0.02
vm-100-disk-1 pve Vwi-a-tz-- 40.00g data 1.62
cat /etc/pve/storage.cfg
dir: local
path /var/lib/vz
content iso,backup,vztmpl
lvmthin: local-lvm
thinpool data
vgname pve
content images,rootdir
lvmthin: nvm2
thinpool nvm2
vgname pve
content images,rootdir
lvmthin: nvme2tb
thinpool nvme2tb
vgname nvme2tb
content images,rootdir