Proxmox clustered and SAN problems

D

dastrix

New Member
Feb 21, 2013
9
0
1
Hi All,

Bit of a long shot here I have inherited a 2 node cluster connected to a SAN all fairly new kit, the problem I have is the VM's are all running i am able to start stop etc.

However when i try to migrate from one node to another I get the following

ERROR: migration aborted (duration 00:02:05): Failed to sync data - mount error: mount.nfs: Connection timed out
TASK ERROR: migration aborted

Now if i go into storage view the 2 nodes are visible with red marks in them.

Also if i try to create a new VM I have no storage pools to select from, I cant even select an iso from local storage.

Any help would be great.

Regards


D.
 
pls provide more details about your setup.
 
Not exactly sure what you require however, I have 2 servers with Fibre channel cards in and they are connected directly to the san. Like i said the VM's are all hosted on the san however they start up fine and i can access them. I cant even access the local storage to create a VM

D.
 
Cluster Status for OFAC1 @ Thu Feb 21 18:33:35 2013
Member Status: Quorate


Member Name ID Status
------ ---- ---- ------
pvcn1 1 Online, Local
pvcn2 2 Online

Its the same on both
 
Member Status: Quorate


Member Name ID Status
------ ---- ---- ------
pvcn1 1 Online, Local
pvcn2 2 Online

Member Status: Quorate


Member Name ID Status
------ ---- ---- ------
pvcn1 1 Online
pvcn2 2 Online, Local
 
Server View = Green
Storage View = Red

However the mounts show up and i can see whats on them ie images.
 
cat /etc/pve/storage.cfgdir: local
path /var/lib/vz
content images,iso,vztmpl,rootdir
maxfiles 0


lvm: sata2tb1
vgname fc_2tb_sata1
shared
content images


lvm: ssd420g
vgname fc_420G_ssd1
shared
content images


dir: sde1
path /mnt2
content images,iso,backup
maxfiles 2


dir: sde1-150
path /mnt2/150
content backup
maxfiles 1


lvm: sata2tb2
vgname fc_2tb_sata2
shared
content images


lvm: sas1tb1
vgname fc_1tb_sas1
shared
content images


nfs: dflynfs
disable
path /mnt/pve/dflynfs
server 10.0.30.3
export /dflynfs
options vers=3
content images,iso,backup
maxfiles 50


nfs: dflyvmstore
path /mnt/pve/dflyvmstore
server 10.0.30.3
export /5TB-da0-2-6/vm
options vers=3
content images,iso,backup
maxfiles 2

mount
/dev/mapper/pve-root on / type ext3 (rw,errors=remount-ro)
tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
udev on /dev type tmpfs (rw,mode=0755)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
/dev/mapper/pve-data on /var/lib/vz type ext3 (rw)
/dev/sda1 on /boot type ext3 (rw)
fusectl on /sys/fs/fuse/connections type fusectl (rw)
/dev/fuse on /etc/pve type fuse (rw,nosuid,nodev,default_permissions,allow_other)
none on /sys/kernel/config type configfs (rw)
beancounter on /proc/vz/beancounter type cgroup (rw,name=beancounter)
container on /proc/vz/container type cgroup (rw,name=container)
fairsched on /proc/vz/fairsched type cgroup (rw,name=fairsched)

pvs
PV VG Fmt Attr PSize PFree
/dev/sda2 pve lvm2 a-- 278.86g 16.00g
/dev/sdb fc_2tb_sata2 lvm2 a-- 1.90t 925.59g
/dev/sdc fc_1tb_sas1 lvm2 a-- 1.14t 2.34g
/dev/sdd fc_2tb_sata1 lvm2 a-- 1.90t 905.59g
/dev/sdf fc_420G_ssd1 lvm2 a-- 389.48g 259.48g

vgs
VG #PV #LV #SN Attr VSize VFree
fc_1tb_sas1 1 5 0 wz--n- 1.14t 2.34g
fc_2tb_sata1 1 7 0 wz--n- 1.90t 905.59g
fc_2tb_sata2 1 6 0 wz--n- 1.90t 925.59g
fc_420G_ssd1 1 1 0 wz--n- 389.48g 259.48g
pve 1 3 0 wz--n- 278.86g 16.00g

lvs
LV VG Attr LSize Pool Origin Data% Move Log Copy% Convert
vm-301-disk-1 fc_1tb_sas1 -wi-a--- 70.00g
vm-302-disk-1 fc_1tb_sas1 -wi-a--- 140.00g
vm-302-disk-2 fc_1tb_sas1 -wi-a--- 95.00g
vm-303-disk-1 fc_1tb_sas1 -wi-a--- 140.00g
vm-303-disk-2 fc_1tb_sas1 -wi-a--- 720.00g
vm-102-disk-1 fc_2tb_sata1 -wi-ao-- 30.00g
vm-103-disk-1 fc_2tb_sata1 -wi-a--- 10.00g
vm-109-disk-1 fc_2tb_sata1 -wi-ao-- 60.00g
vm-150-disk-1 fc_2tb_sata1 -wi-a--- 120.00g
vm-153-disk-1 fc_2tb_sata1 -wi-a--- 120.00g
vm-153-disk-2 fc_2tb_sata1 -wi-a--- 500.00g
vm-201-disk-1 fc_2tb_sata1 -wi-a--- 200.00g
vm-400-disk-1 fc_2tb_sata2 -wi-ao-- 120.00g
vm-500-disk-1 fc_2tb_sata2 -wi-a--- 100.00g
vm-501-disk-1 fc_2tb_sata2 -wi-ao-- 100.00g
vm-501-disk-2 fc_2tb_sata2 -wi-ao-- 100.00g
vm-502-disk-1 fc_2tb_sata2 -wi-ao-- 100.00g
vm-502-disk-2 fc_2tb_sata2 -wi-ao-- 500.00g
vm-103-disk-1 fc_420G_ssd1 -wi-a--- 130.00g
data pve -wi-ao-- 158.24g
root pve -wi-ao-- 69.75g
swap pve -wi-ao-- 34.88g
 
dastrix said:
Server View = Green
Storage View = Red

However the mounts show up and i can see whats on them ie images.
Click to expand...
Your cluster is fine then. In my cluster the servers are also showing red in storage view. Maybe your facing a problem with mount points using direct LUN or your storage is mounted with shared no
 
Well it seems a bit odd because it has worked for ages and only stopped working a few weeks ago, how do i check if the sharing is set to no? how do i check the mount points?

- - - Updated - - -

Also another little problem i see is that in the gui when looking at the virtual machines the summery tab doesnt display everything ie it says no name and doesnt give me any results for cpu usage etc.
 
dastrix said:
cat /etc/pve/storage.cfg
Code: 
...
dir: sde1
        path /mnt2
        content images,iso,backup
        maxfiles 2

dir: sde1-150
        path /mnt2/150
        content backup
        maxfiles 1

nfs: dflyvmstore
        path /mnt/pve/dflyvmstore
        server 10.0.30.3
        export /5TB-da0-2-6/vm
        options vers=3
        content images,iso,backup
        maxfiles 2
...
Code: 
mount
/dev/mapper/pve-root on / type ext3 (rw,errors=remount-ro)
tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
udev on /dev type tmpfs (rw,mode=0755)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
/dev/mapper/pve-data on /var/lib/vz type ext3 (rw)
/dev/sda1 on /boot type ext3 (rw)
fusectl on /sys/fs/fuse/connections type fusectl (rw)
/dev/fuse on /etc/pve type fuse (rw,nosuid,nodev,default_permissions,allow_other)
none on /sys/kernel/config type configfs (rw)
beancounter on /proc/vz/beancounter type cgroup (rw,name=beancounter)
container on /proc/vz/container type cgroup (rw,name=container)
fairsched on /proc/vz/fairsched type cgroup (rw,name=fairsched)
Click to expand...
Hi,
your nfs-server isn't mounted - this is the problem!!

The directory /mnt2 and /mnt2/150 are also not mounted - e.g. the content are on the root partition (it's ok if volitional).

Udo
 
dastrix said:
Well it seems a bit odd because it has worked for ages and only stopped working a few weeks ago, how do i check if the sharing is set to no? how do i check the mount points?

- - - Updated - - -

Also another little problem i see is that in the gui when looking at the virtual machines the summery tab doesnt display everything ie it says no name and doesnt give me any results for cpu usage etc.
Click to expand...

as udo said - your NFS doesn't show up (that's your "shared FS" for ISOs etc.) - and from our experience, a configured but non-working NFS service also could affect the GUI in showing strange things...
 
So any ideas why i cant create any new vms or migrate, what can i check how do i change shared value for the mounted storage?
 
If your vm's are stored locally due to missing NFS mounts they are by definition stored on a non-shared storage in which case the cannot be live migrated. As you are not able to create new vm's follows the first paragraph - you have no NFS mounts available.
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back