Hello all,
I would like to have some advice on a configuration problem with a new server we bought recently. It is a Dell PE R730 with two 200 GB SSDs in Raid 1, and 8 500 GB NLSAS drives in Raid 10.
We bought this configuration to use in the future this server in a Ceph cluster.as described in Proxmox Ceph Documentation. But for now, we don't have the three servers required to set up a miminal cluter, so we installed it as a normal proxmox server with local storage using last iso PVE 4.2.
The two SSDs in Raid 1 are seen as /dev/sda, and the 8 NLSAS in Raid 10 as /dev/sdb. During installation, PVE 4.2 was installed on /dev/sda. It went OK but after reboot, only a small 45 GB appeared as local storage under /var/lib/vz. The other Raid 10 volume with ~2 To of space was not available.
With PVE 4.2, there is the possibility to use Thin LVM, which enable snapshot and clone, so I thought it would be interesting to setup the additional storage as a thin LVM storage.
For those interested, I used these commands to achieve this, following the wiki:
Then I was able to add this storage as thin LVM in proxmox web interface. So far, all is right.
But then, I added the server in an existing proxmox cluster, with all nodes using a local storage under /var/lib/vz. The thin LVM storage at first disappeared, but I was able to re-add it when connecting on this node.
But when I try to do an offline migration from one local storage on another node to this new node, the VM is migrated by default under the /var/lib/vz storage which has only 45 GB, and not to the thin LVM storage with 2 TB... And there is no option in the migration GUI (or in commande line), to specify the storage.
So my questions are :
- is there a possibility to offline migrate a VM from a standard /var/lib/vz storage to a thin LVM volume on another node ?
- in case it is, is it possible to define the thin LVM storage as the default one for migration ?
- Or alternatively, is it possible to remove the /var/lib/vz storage, so that only the thin LVM volume remains, and uses it for offline migration ?
I fear I cannot use thin LVM storage for a new node in a cluster which is configured with old local /var/lib/vz storage, and that I have to reconfigure the new server.
What are the best options in this case ?
Thank for your advices.
Alain
I would like to have some advice on a configuration problem with a new server we bought recently. It is a Dell PE R730 with two 200 GB SSDs in Raid 1, and 8 500 GB NLSAS drives in Raid 10.
We bought this configuration to use in the future this server in a Ceph cluster.as described in Proxmox Ceph Documentation. But for now, we don't have the three servers required to set up a miminal cluter, so we installed it as a normal proxmox server with local storage using last iso PVE 4.2.
The two SSDs in Raid 1 are seen as /dev/sda, and the 8 NLSAS in Raid 10 as /dev/sdb. During installation, PVE 4.2 was installed on /dev/sda. It went OK but after reboot, only a small 45 GB appeared as local storage under /var/lib/vz. The other Raid 10 volume with ~2 To of space was not available.
With PVE 4.2, there is the possibility to use Thin LVM, which enable snapshot and clone, so I thought it would be interesting to setup the additional storage as a thin LVM storage.
For those interested, I used these commands to achieve this, following the wiki:
Code:
# sgdisk -p /dev/sdb
# pvcreate --metadatasize 250k -y -ff /dev/sdb1
# vgcreate raid10-pve /dev/sdb1
# lvcreate -L 1.8T -T -n raid10-store raid10-pve
Then I was able to add this storage as thin LVM in proxmox web interface. So far, all is right.
But then, I added the server in an existing proxmox cluster, with all nodes using a local storage under /var/lib/vz. The thin LVM storage at first disappeared, but I was able to re-add it when connecting on this node.
But when I try to do an offline migration from one local storage on another node to this new node, the VM is migrated by default under the /var/lib/vz storage which has only 45 GB, and not to the thin LVM storage with 2 TB... And there is no option in the migration GUI (or in commande line), to specify the storage.
So my questions are :
- is there a possibility to offline migrate a VM from a standard /var/lib/vz storage to a thin LVM volume on another node ?
- in case it is, is it possible to define the thin LVM storage as the default one for migration ?
- Or alternatively, is it possible to remove the /var/lib/vz storage, so that only the thin LVM volume remains, and uses it for offline migration ?
I fear I cannot use thin LVM storage for a new node in a cluster which is configured with old local /var/lib/vz storage, and that I have to reconfigure the new server.
What are the best options in this case ?
Thank for your advices.
Alain
Last edited: