[SOLVED] ZFS over iscsi auth issues

[Sp00nman]

Hi all,

Running a PVE7 cluster with 9 nodes.

Am in the process of setting up block storage on the cluster to a Pure flash array.

I have the iscsi connectivity in place and working

My issue is that proxmox is trying to connect to the Pure appliance using 'root' user which it is not allowed by the appliance manufacturer:

root@proxmox-host-08:/# /usr/bin/ssh -o 'BatchMode=yes' -i /etc/pve/priv/zfs/100.64.10.47_id_rsa root@100.64.10.47
root@100.64.10.47: Permission denied (publickey,password).
root@proxmox-host-08:/#


Using user created on pure appliance:

root@proxmox-host-08:/# /usr/bin/ssh -o 'BatchMode=yes' -i /etc/pve/priv/zfs/100.64.10.47_id_rsa block@100.64.10.47
Last login: Thu Jul 22 11:20:21 2021 from 10.212.134.18

Thu Jul 22 15:46:24 2021
Welcome block. This is Purity Version 6.1.6 on FlashArray pure-poc
http://www.purestorage.com/
block@pure-poc> ^C


Does anyone know how I would be able to get the system to natively connect using a custom user and not root?

Thanks in advance!

 

[Sp00nman]

Error from syslog:

Jul 22 15:38:57 proxmox-host-08 pvestatd[5283]: command '/usr/bin/ssh -o 'BatchMode=yes' -i /etc/pve/priv/zfs/100.64.10.47_id_rsa root@100.64.10.47 zfs get -o value -Hp available,used rpool' failed: exit code 255

 

[bbgeek17]

ZFS over iSCSI storage is only available for Linux/BSD hosts.

Its literally:
login as privileged (mostly root) user to Linux host that has ZFS pool
create a slice
export it via supported iscsi daemon

Your pure storage does not fit any of the above, you are limited to LVM over iscsi, or direct LUNs

 

[Sp00nman]

Thanks bbgeek17 - I was able to get the storage up using LVM over iscsi!!

 

[bbgeek17]

awesome, good job.
Keep in mind that there are limitations with LVM and shared storage, specifically around Proxmox initiated snapshots.

 

[Sp00nman]

Thanks - i saw that - using pve backup server for these (and most other) workloads

 

[lowerym]

bbgeek17,
Would you mind sharing your multipathd.conf for the pure storage? i am configuring one myself and multipath is not my strong suit.

Thanks

 

[bbgeek17]

Hi @lowerym, I dont run pure so I dont have anything pure specific to share with you.
These are good keywords to use in your search: "pure storage iscsi multipath"

First google hit: https://support.purestorage.com/Sol...figuring_Linux_Host_for_iSCSI_with_FlashArray

---

Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[Sp00nman]

Sure thing:

joe /etc/multipath.conf

defaults {
user_friendly_names no
find_multipaths "yes"
}
devices {
device {
vendor "PURE"
product "FlashArray"
path_grouping_policy group_by_prio
hardware_handler "1 alua"
prio alua
failback "immediate"
fast_io_fail_tmo 10
}
}