PLease Help! ISCSI Problem

tylerdurden81

Member
Jan 8, 2011
124
0
16
So this morning a vm was not working. (KVM) I try to reboot it and it stops at booting from hard drive. I Look at my storage and the image for the VM is not showing up. (vm-188-disk-1) But if i SSH into the mode the image is there. What can i do to fix this?

proxmox8:~# pveversion
pve-manager/1.8/5754



Also i noticed that the master is seeing different iscsi images the node this VM is on. There are images that dont even exist showing up on the master.

proxmox1:/dev/openfiler3# ls
vm-114-disk-1 vm-144-disk-1 vm-155-disk-1 vm-181-disk-1 vm-188-disk-1
vm-123-disk-1 vm-145-disk-1 vm-156-disk-1 vm-182-disk-1 vm-188-disk-2
vm-137-disk-1 vm-146-disk-1 vm-157-disk-1 vm-183-disk-1 vm-189-disk-1
vm-138-disk-1 vm-147-disk-1 vm-158-disk-1 vm-184-disk-1 vm-190-disk-1
vm-140-disk-1 vm-148-disk-1 vm-176-disk-1 vm-185-disk-1
vm-142-disk-1 vm-149-disk-1 vm-177-disk-1 vm-186-disk-1
vm-143-disk-1 vm-151-disk-1 vm-178-disk-1 vm-187-disk-1


VS


proxmox8:/dev/openfiler3# ls
vm-114-disk-1 vm-144-disk-1 vm-155-disk-1 vm-181-disk-1 vm-189-disk-1
vm-123-disk-1 vm-145-disk-1 vm-156-disk-1 vm-182-disk-1 vm-190-disk-1
vm-137-disk-1 vm-146-disk-1 vm-157-disk-1 vm-183-disk-1 vm-54-disk-1
vm-138-disk-1 vm-147-disk-1 vm-158-disk-1 vm-184-disk-1
vm-140-disk-1 vm-148-disk-1 vm-176-disk-1 vm-186-disk-1
vm-142-disk-1 vm-149-disk-1 vm-177-disk-1 vm-187-disk-1
vm-143-disk-1 vm-151-disk-1 vm-178-disk-1 vm-188-disk-1
 
Last edited:
So this morning a vm was not working. (KVM) I try to reboot it and it stops at booting from hard drive. I Look at my storage and the image for the VM is not showing up. (vm-188-disk-1) But if i SSH into the mode the image is there. What can i do to fix this?

proxmox8:~# pveversion
pve-manager/1.8/5754



Also i noticed that the master is seeing different iscsi images the node this VM is on. There are images that dont even exist showing up on the master.

proxmox1:/dev/openfiler3# ls
vm-114-disk-1 vm-144-disk-1 vm-155-disk-1 vm-181-disk-1 vm-188-disk-1
vm-123-disk-1 vm-145-disk-1 vm-156-disk-1 vm-182-disk-1 vm-188-disk-2
vm-137-disk-1 vm-146-disk-1 vm-157-disk-1 vm-183-disk-1 vm-189-disk-1
vm-138-disk-1 vm-147-disk-1 vm-158-disk-1 vm-184-disk-1 vm-190-disk-1
vm-140-disk-1 vm-148-disk-1 vm-176-disk-1 vm-185-disk-1
vm-142-disk-1 vm-149-disk-1 vm-177-disk-1 vm-186-disk-1
vm-143-disk-1 vm-151-disk-1 vm-178-disk-1 vm-187-disk-1


VS


proxmox8:/dev/openfiler3# ls
vm-114-disk-1 vm-144-disk-1 vm-155-disk-1 vm-181-disk-1 vm-189-disk-1
vm-123-disk-1 vm-145-disk-1 vm-156-disk-1 vm-182-disk-1 vm-190-disk-1
vm-137-disk-1 vm-146-disk-1 vm-157-disk-1 vm-183-disk-1 vm-54-disk-1
vm-138-disk-1 vm-147-disk-1 vm-158-disk-1 vm-184-disk-1
vm-140-disk-1 vm-148-disk-1 vm-176-disk-1 vm-186-disk-1
vm-142-disk-1 vm-149-disk-1 vm-177-disk-1 vm-187-disk-1
vm-143-disk-1 vm-151-disk-1 vm-178-disk-1 vm-188-disk-1
Hi,
but disk vm-188-disk-1 appear on both nodes.
What happens if you append ",cache=writethrough" on the disk-entry in /etc/qemu-server/188.conf?

The logical volumes:
if you do an
Code:
lvscan
lvs -o lv_all
do you see on both nodes the same?

Udo
 
lvscan
ACTIVE '/dev/openfiler192.168.2.83/vm-191-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler192.168.2.83/vm-188-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-101-disk-1' [30.00 GB] inherit
ACTIVE Original '/dev/OPENFILER/vm-101-disk-2' [200.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-104-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-105-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-106-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-103-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-107-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-108-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-109-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-110-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-102-disk-1' [30.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-111-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-112-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-113-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-115-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-116-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-117-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-118-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-120-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-121-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-122-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-124-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-125-disk-1' [32.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-126-disk-1' [32.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-127-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-129-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-130-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-131-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-132-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-127-disk-2' [40.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-133-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-134-disk-1' [32.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-135-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-136-disk-1' [90.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-139-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-141-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-129-disk-2' [30.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-150-disk-1' [32.00 GB] inherit
ACTIVE Snapshot '/dev/OPENFILER/vzsnap-proxmox1-0' [1.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-114-disk-1' [10.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-123-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-137-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-138-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-140-disk-1' [10.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-143-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-144-disk-1' [10.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-145-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-146-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-147-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-148-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-149-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-151-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-155-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-156-disk-1' [10.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-157-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-158-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-176-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-178-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-177-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-181-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-182-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-183-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-142-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-184-disk-1' [110.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-186-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-187-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-189-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-190-disk-1' [32.00 GB] inherit
ACTIVE '/dev/pve/swap' [7.00 GB] inherit
ACTIVE '/dev/pve/root' [74.50 GB] inherit
ACTIVE '/dev/pve/data' [212.09 GB] inherit
 
lvscan
ACTIVE '/dev/openfiler192.168.2.83/vm-191-disk-1' [50.00 GB] inherit
inactive '/dev/openfiler192.168.2.83/vm-188-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-114-disk-1' [10.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-123-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-137-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-138-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-140-disk-1' [10.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-143-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-144-disk-1' [10.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-145-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-146-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-147-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-148-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-149-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-151-disk-1' [50.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-155-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-156-disk-1' [10.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-157-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-158-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-176-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-178-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-177-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-181-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-182-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-183-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-142-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-184-disk-1' [110.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-186-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-187-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-189-disk-1' [32.00 GB] inherit
ACTIVE '/dev/openfiler3/vm-190-disk-1' [32.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-101-disk-1' [30.00 GB] inherit
ACTIVE Original '/dev/OPENFILER/vm-101-disk-2' [200.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-104-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-105-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-106-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-103-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-107-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-108-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-109-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-110-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-102-disk-1' [30.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-111-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-112-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-113-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-115-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-116-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-117-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-118-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-120-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-121-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-122-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-124-disk-1' [50.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-125-disk-1' [32.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-126-disk-1' [32.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-127-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-129-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-130-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-131-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-132-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-127-disk-2' [40.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-133-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-134-disk-1' [32.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-135-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-136-disk-1' [90.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-139-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-141-disk-1' [10.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-129-disk-2' [30.00 GB] inherit
ACTIVE '/dev/OPENFILER/vm-150-disk-1' [32.00 GB] inherit
ACTIVE Snapshot '/dev/OPENFILER/vzsnap-proxmox1-0' [1.00 GB] inherit
ACTIVE '/dev/pve/swap' [4.00 GB] inherit
ACTIVE '/dev/pve/root' [18.50 GB] inherit
ACTIVE '/dev/pve/data' [47.51 GB] inherit
 
Hi,
on your first post you see on one node vm-188-disk-2?! But now only vm-188-disk-1!?

And why openfiler192.168.2.83 and not openfiler3??
what shows pvdisplay and vgdisplay?

Udo
 
Last edited:
I ended up deleting the vm-188 images and reinstalling them on a New machine. I have no idea where the disk 2 came from. I did not add it. The openfiler3 was getting to about 85% full so i just moved the image over to a new server. I would still like to know what happened though. Is it normal for different nodes to have different images show up?