ZFS over ISCSI

[encore]

Hi,

I am trying to setup a Zpool and share it over ISCSI for my proxmox nodes.
After I created the zpool "kvmstor-01" on /dev/sde I am trying to create the backstore block in targetcli.
Unfortunetaly I get:

Cannot configure StorageObject because device /dev/sde is already in use

I know, zpool mounts itself to /<zpoolname> after creation, I already umounted it.

I am only able to create a ZVOL on that Zpool and create a backstore block for it.
But Proxmox wants access to the whole Zpool, doesn't it?

What am I doing wrong?

Thank you!

 

[wolfgang]

Hi,

I think you mix dataset with zvols.
ZFS provides different types of datasets.
Zvols, filesystem and snapshots are relevant for Proxmox VE.
We use filesystem dataset for LXC and zvols for KVM.
If you like to use ISCSI you need to create zvols, not filesystem dataset.
Zvols are block devices and they are not mounted.
The path of a zfs zvol is /dev/zd<number> and mapped to /dev/zvol/<poolname>/<dataset>

 

[encore]

Hi,

I think you mix dataset with zvols.
ZFS provides different types of datasets.
Zvols, filesystem and snapshots are relevant for Proxmox VE.
We use filesystem dataset for LXC and zvols for KVM.
If you like to use ISCSI you need to create zvols, not filesystem dataset.
Zvols are block devices and they are not mounted.
The path of a zfs zvol is /dev/zd<number> and mapped to /dev/zvol/<poolname>/<dataset>

awesome, got it!
Looks fine in proxmox now:
http://prntscr.com/jogshl

But when I try to create VM on it, I get:

TASK ERROR: create failed - error with cfs lock 'storage-zpool-kvmstor-01': No configuration found. Install iet on 10.10.10.10 at /usr/share/perl5/PVE/Storage/LunCmd/Iet.pm line 113.

Storage config part:

zfs: zpool-kvmstor-01
blocksize 4k
iscsiprovider iet
pool kvmstor-01
portal 10.10.10.10
target iqn.2003-01.org.linux-iscsi.zpool-kvmstor-01:kvmstor-01
content images
nodes captive003-77030
nowritecache 0
sparse 1

zpool-kvmstor-01 is the zpool. The ZVOL with 100% disk usage of the ZPOOL is called kvmstor-01

Looks like he also created the disk volume on the ZFS storage:
http://prntscr.com/jogtes

What did I wrong?

 

[wolfgang]

Why do you use a local zfs over iscsi?

 

[encore]

Why do you use a local zfs over iscsi?

it is not a local zfs. The zfs runs on a storage server (10.10.10.10). The node where it should be used is called captive003-77030

I still get

TASK ERROR: create failed - error with cfs lock 'storage-zpool-kvmstor-01': No configuration found. Install iet on 10.10.10.10 at /usr/share/perl5/PVE/Storage/LunCmd/Iet.pm line 113.

Seems like iet is missing on the storage server. The server is running Debian 9 maybe thats why it is not included in iscsitarget package?

 

[wolfgang]

What are you using as iscsi target?

 

[encore]

What are you using as iscsi target?

storage.cfg:

zfs: zpool-kvmstor-01
blocksize 4k
iscsiprovider iet
pool kvmstor-01
portal 10.10.10.10
target iqn.2003-01.org.linux-iscsi.zpool-kvmstor-01:kvmstor-01
content images
nodes captive003-77030
nowritecache 0
sparse 1

target is called iqn.2003-01.org.linux-iscsi.zpool-kvmstor-01.

targetcli from storage server:
http://prntscr.com/johvhm