[SOLVED] pve-zsync and iscsi on nappit

R

RobFantini

Famous Member
May 24, 2012
2,042
107
133
Boston,Mass
I'm trying to debug a lvm / iscsi / lxc issue. there may be a bug or something set up wrong.

when I try to ue pve-zsync to backup up a lxc at iscsi :
Code: 
pve-zsync create  --source 10.2.2.21:3040  --name 3040-test  --maxsnap  7 --dest  tank/pve-zsync/Daily
Job --source 10.2.2.21:3040 --name 3040-test got an ERROR!!!
ERROR Message:
COMMAND:
  ssh root@10.2.2.21 -- zfs list -r -t snapshot -Ho name -S creation dev/lxc-iscsi-vg/vm-3040-disk-1
GET ERROR:
  cannot open 'dev/lxc-iscsi-vg/vm-3040-disk-1': dataset does not exist
yet at 10.2.2.21 the data set seems to exist:
Code: 
sys5  /etc/pve/lxc # ip a|grep 10.2.2.21
  inet 10.2.2.21/24 brd 10.2.2.255 scope global eth3
sys5  /etc/pve/lxc # ls -l /dev/lxc-iscsi-vg/vm-3040-disk-1
lrwxrwxrwx 1 root root 7 Apr 13 12:27 /dev/lxc-iscsi-vg/vm-3040-disk-1 -> ../dm-2

here is /etc/pve/lxc/3040.conf :
Code: 
arch: amd64
cpulimit: 1
cpuunits: 1024
hostname: 3032-jessie
memory: 1024
net0: bridge=vmbr1,hwaddr=66:36:62:30:64:64,ip=dhcp,name=eth0,type=veth
onboot: 1
ostype: debian
rootfs: iscsi-for-lxc:vm-3040-disk-1,size=6G
swap: 512

any clues to fix the issue?
 
pve-zsync and kvm on iscsi also have an issue with our set up. last night a moved a kvm disk from local zfs to iscsi. from cronjob email:
Code: 
Subject: Cron <root@sys7> pve-zsync sync --source 10.2.2.42:3120 --dest tank/pve-zsync --name support --maxsnap 7 --method ssh

ERROR: in path

Job --source 10.2.2.42:3120 --name support got an ERROR!!!
ERROR Message:
there was nothing after 'ERROR Message:' .

from /etc/pve/storage.cfg
Code: 
zfs: iscsi-sys4
  target iqn.2010-09.org.napp-it:1459891666
  pool data
  portal 10.2.2.41
  iscsiprovider comstar
  blocksize 8k
  content images
  nowritecache

iscsi: sys4-lxc-vol
  portal 10.2.2.41
  target iqn.2010-09.org.napp-it:1459891666
  content none

lvm: iscsi-for-lxc
  vgname lxc-iscsi-vg
  shared
  base sys4-lxc-vol:0.0.3.scsi-3600144f0000008080000570c0bb60001
  content rootdir

3120.conf:
Code: 
bootdisk: virtio0
cores: 1
memory: 512
name: support
net0: virtio=7A:E1:05:41:AB:21,bridge=vmbr1
onboot: 1
ostype: l26
protection: 1
scsihw: virtio-scsi-pci
sockets: 1
unused0: kvm-zfs:vm-3120-disk-1
virtio0: iscsi-sys4:vm-3120-disk-1,cache=writeback,size=8G
 
RobFantini said:
I'm trying to debug a lvm / iscsi / lxc issue. there may be a bug or something set up wrong.

when I try to ue pve-zsync to backup up a lxc at iscsi :
Code: 
pve-zsync create  --source 10.2.2.21:3040  --name 3040-test  --maxsnap  7 --dest  tank/pve-zsync/Daily
Job --source 10.2.2.21:3040 --name 3040-test got an ERROR!!!
ERROR Message:
COMMAND:
  ssh root@10.2.2.21 -- zfs list -r -t snapshot -Ho name -S creation dev/lxc-iscsi-vg/vm-3040-disk-1
GET ERROR:
  cannot open 'dev/lxc-iscsi-vg/vm-3040-disk-1': dataset does not exist
yet at 10.2.2.21 the data set seems to exist:
Code: 
sys5  /etc/pve/lxc # ip a|grep 10.2.2.21
  inet 10.2.2.21/24 brd 10.2.2.255 scope global eth3
sys5  /etc/pve/lxc # ls -l /dev/lxc-iscsi-vg/vm-3040-disk-1
lrwxrwxrwx 1 root root 7 Apr 13 12:27 /dev/lxc-iscsi-vg/vm-3040-disk-1 -> ../dm-2

any clues to fix the issue?
Click to expand...

what does "ssh root@10.2.2.21 -- zfs list -r -t all" output?
 
fabian said:
what does "ssh root@10.2.2.21 -- zfs list -r -t all" output?
Click to expand...
Code: 
ssh root@10.2.2.21 -- zfs list -r -t all
Warning: Permanently added '10.2.2.21' (ECDSA) to the list of known hosts.
NAME  USED  AVAIL  REFER  MOUNTPOINT
rpool  65.0G  396G  96K  /rpool
rpool/ROOT  1.73G  396G  96K  /rpool/ROOT
rpool/ROOT/pve-1  1.73G  396G  1.73G  /
rpool/swap  63.2G  452G  7.19G  -
tank  842G  4.45T  96K  /tank
tank/bkup  203G  4.45T  203G  /bkup
tank/bluecherry  96K  2.00T  96K  /tank/bluecherry
tank/kvm  140G  4.45T  96K  /tank/kvm
tank/kvm/vm-103-disk-1  9.28G  4.45T  4.81G  -
tank/kvm/vm-5103-disk-1  7.22G  4.45T  4.72G  -
tank/kvm/vm-5103-disk-2  124G  4.52T  42.2G  -
tank/lxc  82.0G  4.45T  104K  /tank/lxc
tank/lxc/subvol-102-disk-1  1.12G  4.88G  1.12G  /tank/lxc/subvol-102-disk-1
tank/lxc/subvol-106-disk-1  72.8G  27.2G  72.8G  /tank/lxc/subvol-106-disk-1
tank/lxc/subvol-3102-disk-1  942M  1.08G  942M  /tank/lxc/subvol-3102-disk-1
tank/lxc/subvol-3945-disk-1  924M  5.10G  924M  /tank/lxc/subvol-3945-disk-1
tank/lxc/subvol-4106-disk-1  2.81G  13.2G  2.81G  /tank/lxc/subvol-4106-disk-1
tank/lxc/subvol-4501-disk-1  3.51G  10.5G  3.51G  /tank/lxc/subvol-4501-disk-1
tank/nfs  290G  4.45T  290G  /nfs
tank/obnam  42.8G  4.45T  42.8G  /obnam
tank/obnam-desktops  83.9G  4.45T  83.9G  /obnam-desktops
tank/pve-zsync  96K  4.45T  96K  /tank/pve-zsync
 
pve-zsync is correct, there is no zfs dataset called "dev/lxc-iscsi-vg/vm-3040-disk-1" on that host. are you even exporting zfs over iscsi here? or are you doing zfs on top of iscsi?
 
fabian said:
pve-zsync is correct, there is no zfs dataset called "dev/lxc-iscsi-vg/vm-3040-disk-1" on that host. are you even exporting zfs over iscsi here? or are you doing zfs on top of iscsi?
Click to expand...
I do not know how to tell which is used.

here is storage.cfg parts:
Code: 
zfs: iscsi-sys4
  target iqn.2010-09.org.napp-it:1459891666
  pool data
  portal 10.2.2.41
  iscsiprovider comstar
  blocksize 8k
  content images
  nowritecache

iscsi: sys4-lxc-vol
  portal 10.2.2.41
  target iqn.2010-09.org.napp-it:1459891666
  content none

lvm: iscsi-for-lxc
  vgname lxc-iscsi-vg
  shared
  base sys4-lxc-vol:0.0.3.scsi-3600144f0000008080000570c0bb60001
  content rootdir

and .conf

Code: 
grep iscsi /etc/pve/qemu-server/*

/etc/pve/qemu-server/111.conf:virtio0: iscsi-sys4:vm-111-disk-1,size=16392M
/etc/pve/qemu-server/7210.conf:virtio0: iscsi-sys4:vm-7210-disk-1,size=7G
 
Last edited:
RobFantini said:
I do not know how to tell which is used.

here is storage.cfg parts:
Code: 
zfs: iscsi-sys4
  target iqn.2010-09.org.napp-it:1459891666
  pool data
  portal 10.2.2.41
  iscsiprovider comstar
  blocksize 8k
  content images
  nowritecache

iscsi: sys4-lxc-vol
  portal 10.2.2.41
  target iqn.2010-09.org.napp-it:1459891666
  content none

lvm: iscsi-for-lxc
  vgname lxc-iscsi-vg
  shared
  base sys4-lxc-vol:0.0.3.scsi-3600144f0000008080000570c0bb60001
  content rootdir

and .conf

Code: 
grep iscsi /etc/pve/qemu-server/*

/etc/pve/qemu-server/111.conf:virtio0: iscsi-sys4:vm-111-disk-1,size=16392M
/etc/pve/qemu-server/7210.conf:virtio0: iscsi-sys4:vm-7210-disk-1,size=7G
Click to expand...

Note I had already deleted test vm 3040 ..
 
7120 pve-zsync attempt:
Code: 
pve-zsync create  --source 10.2.2.21:7210 --name www-test --maxsnap  7 --dest  tank/pve-zsync/Daily
ERROR: in path
 
You must log in or register to reply here.
Top Bottom