second hdd problem

peterx

Renowned Member
May 5, 2008
41
1
73
Hello,

I have two proxmox in a cluster.
On proxmox1 I added a second hdd (LVM) to a kvm vm with Freenas.
Works perfect. But on proxmox2 I get the following error when opening the tab hardware on every kvm vm:
[4513]ERR: 24: Error in Perl code: command '/sbin/vgchange -aly hdd101-c' failed with exit code 5

Apache Embperl 2.2.0 [Mon Dec 14 20:42:20 2009]
hdd101-c is the name of the second hdd.

Both proxmox machines are updated to the latest versions.
Some information:
-------------------------------------------------------------------

proxmox1:~# pvscan
PV /dev/sdc1 VG hdd101-c lvm2 [931,51 GB / 131,51 GB free]
PV /dev/sda2 VG pve lvm2 [931,01 GB / 3,99 GB free]
Total: 2 [1,82 TB] / in use: 2 [1,82 TB] / in no VG: 0 [0 ]
--------------------------------------------------------------------------------
proxmox2:~# pvscan
PV /dev/sda2 VG pve lvm2 [931,01 GB / 3,99 GB free]
Total: 1 [931,01 GB] / in use: 1 [931,01 GB] / in no VG: 0 [0 ]
----------------------------------------------------------------------------
proxmox1:~# cat /etc/pve/storage.cfg
dir: local
path /var/lib/vz
shared
content images,iso,vztmpl,rootdir

dir: backup
path /mnt/backup
shared
content backup

nfs: isosproxmoxfreenas
path /mnt/pve/isosproxmoxfreenas
server 192.168.0.184
export /mnt/Disk1/isosproxmox/
content iso

lvm: freenas2
vgname hdd101-c
shared
content images
---------------------------------------------------------------------------
proxmox2:~# cat /etc/pve/storage.cfg
dir: local
path /var/lib/vz
shared
content images,iso,vztmpl,rootdir

dir: backup
path /mnt/backup
shared
content backup

nfs: isosproxmoxfreenas
path /mnt/pve/isosproxmoxfreenas
server 192.168.0.184
export /mnt/Disk1/isosproxmox/
content iso

lvm: freenas2
vgname hdd101-c
shared
content images

----------------------------------------------------------------------------
proxmox1:~# fdisk -l

Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Device Boot Start End Blocks Id System
/dev/sda1 * 1 66 524288 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2 66 121601 976235712 8e Linux LVM

Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x3bbabddd

Device Boot Start End Blocks Id System
/dev/sdb1 1 121601 976760001 7 HPFS/NTFS

Disk /dev/sdc: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x3bbabddc

Device Boot Start End Blocks Id System
/dev/sdc1 1 121601 976760001 8e Linux LVM

Disk /dev/dm-0: 4294 MB, 4294967296 bytes
255 heads, 63 sectors/track, 522 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-0 doesn't contain a valid partition table

Disk /dev/dm-1: 103.0 GB, 103079215104 bytes
255 heads, 63 sectors/track, 12532 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-1 doesn't contain a valid partition table

Disk /dev/dm-2: 888.0 GB, 888001265664 bytes
255 heads, 63 sectors/track, 107960 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-2 doesn't contain a valid partition table

WARNING: GPT (GUID Partition Table) detected on '/dev/dm-3'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/dm-3: 858.9 GB, 858993459200 bytes
256 heads, 63 sectors/track, 104025 cylinders
Units = cylinders of 16128 * 512 = 8257536 bytes
Disk identifier: 0x00000000

Device Boot Start End Blocks Id System
/dev/dm-3p1 1 104026 838860799+ ee EFI GPT

proxmox2:~# fdisk -l

Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Device Boot Start End Blocks Id System
/dev/sda1 * 1 66 524288 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2 66 121601 976235712 8e Linux LVM

Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/sdb doesn't contain a valid partition table

Disk /dev/dm-0: 7516 MB, 7516192768 bytes
255 heads, 63 sectors/track, 913 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-0 doesn't contain a valid partition table

Disk /dev/dm-1: 103.0 GB, 103079215104 bytes
255 heads, 63 sectors/track, 12532 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-1 doesn't contain a valid partition table

Disk /dev/dm-2: 884.7 GB, 884780040192 bytes
255 heads, 63 sectors/track, 107568 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-2 doesn't contain a valid partition table
----------------------------------------------------------------------

proxmox2:~# fdisk -l

Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Device Boot Start End Blocks Id System
/dev/sda1 * 1 66 524288 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2 66 121601 976235712 8e Linux LVM

Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/sdb doesn't contain a valid partition table

Disk /dev/dm-0: 7516 MB, 7516192768 bytes
255 heads, 63 sectors/track, 913 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-0 doesn't contain a valid partition table

Disk /dev/dm-1: 103.0 GB, 103079215104 bytes
255 heads, 63 sectors/track, 12532 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-1 doesn't contain a valid partition table

Disk /dev/dm-2: 884.7 GB, 884780040192 bytes
255 heads, 63 sectors/track, 107568 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00000000

Disk /dev/dm-2 doesn't contain a valid partition table
---------------------------------------------------------------------

What's wrong?
Peter
 
Hi, if i see it right, your second lvm on the first proxmos is only local - so your second server can't see the lvm. So, you must marked the storage not as shared. then the storage is only active on this node. Udo
 
Or you add a reference to the base storage. I guess freenas2
is on a iscsi export? If so, you can use something like:

Code:
iscsi: iscsi1
        portal 192.168.2.XXX
        target iqn.2006-01.com.openfiler:tsn.39ab355c3aee
        content none
 
lvm: freenas2
       vgname hdd101-c
       base iscsi1:0.0.0.scsi-14f504e46494c45007258485239752d316e52422d45626a50
       shared
       content images

You can use the web interface to configure this.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!