Hi Proxmoxers!
Several days ago I've started to test Proxmox VE in order to have some let say balanced alternative to expensive VMware and hardcore virsh-managed KVM environment on the other side. First impression was so promising - very intuitive interface and easy to backup vm capability. I've read Proxmox wiki and found not much about shared storage. I've installed pve on 2 nodes which are connected to the both canisters of Storwize V3700 using SAS HBAs and appropriate cables. Set up cluster, multipathing except friendly names of LUNs, because I couldn't found bindings file (I've got device like /dev/mapper/wwwwwwiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiid
. Of course I could use settings from http://www-01.ibm.com/support/knowl...e.v3700.740.doc/svc_linux_settings_copy1.html but I've found that is hardcoded in multipath deamon. Doesn't matter at all. It isn't clue but if you have some consideration about this please share.
Then I made some mess with LVM:
first LUN:
fdisk /dev/mapper/1234567890abcdef01230000000000000
and created one primary partition by default (only 2TB as later it turned out)
pvcreate /dev/mapper/1234567890abcdef01230000000000000-part1
vgcreate vmstore1 /dev/mapper/1234567890abcdef01230000000000000-part1
second LUN (after some days and posts and wikis):
fdisk /dev/mapper/1234567890abcdef01230000000000001
and created one 3TB primary partition type 8e
pvcreate /dev/mapper/1234567890abcdef01230000000000001
vgcreate vmstore2 /dev/mapper/1234567890abcdef01230000000000001
Both LUNs are visible to PVE and usable as storage for vms. So my question are:
What is proper way to make LVM storage (like 1st or 2nd LUN)?
Is there any way to move data (LV) from one vg to another?
Should I change locking_type to = 3 (Type 3 uses built-in clustered locking) in /etc/lvm/lvm.conf?
The only disadvantage so far is the lack of making snapshots in LVM storage. AFAIK it is possible in file-based storage for virtualization and qcow2 file format. My first thoughts goes to GFS2. Can I use this file system (add to /etc/fstab and then to PVE like "Directory")? What about performance and stability?
Several days ago I've started to test Proxmox VE in order to have some let say balanced alternative to expensive VMware and hardcore virsh-managed KVM environment on the other side. First impression was so promising - very intuitive interface and easy to backup vm capability. I've read Proxmox wiki and found not much about shared storage. I've installed pve on 2 nodes which are connected to the both canisters of Storwize V3700 using SAS HBAs and appropriate cables. Set up cluster, multipathing except friendly names of LUNs, because I couldn't found bindings file (I've got device like /dev/mapper/wwwwwwiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiid
. Of course I could use settings from http://www-01.ibm.com/support/knowl...e.v3700.740.doc/svc_linux_settings_copy1.html but I've found that is hardcoded in multipath deamon. Doesn't matter at all. It isn't clue but if you have some consideration about this please share.Then I made some mess with LVM:
first LUN:
fdisk /dev/mapper/1234567890abcdef01230000000000000
and created one primary partition by default (only 2TB as later it turned out)
pvcreate /dev/mapper/1234567890abcdef01230000000000000-part1
vgcreate vmstore1 /dev/mapper/1234567890abcdef01230000000000000-part1
second LUN (after some days and posts and wikis):
fdisk /dev/mapper/1234567890abcdef01230000000000001
and created one 3TB primary partition type 8e
pvcreate /dev/mapper/1234567890abcdef01230000000000001
vgcreate vmstore2 /dev/mapper/1234567890abcdef01230000000000001
Both LUNs are visible to PVE and usable as storage for vms. So my question are:
What is proper way to make LVM storage (like 1st or 2nd LUN)?
Is there any way to move data (LV) from one vg to another?
Should I change locking_type to = 3 (Type 3 uses built-in clustered locking) in /etc/lvm/lvm.conf?
The only disadvantage so far is the lack of making snapshots in LVM storage. AFAIK it is possible in file-based storage for virtualization and qcow2 file format. My first thoughts goes to GFS2. Can I use this file system (add to /etc/fstab and then to PVE like "Directory")? What about performance and stability?
Last edited: