External Storage question

[dhmusil]

All,

We have created a six (6)node CEPH cluster that is presenting iSCSI targets with single images attached. There are three (3) of the CEPH nodes that are presenting these images.

We have created a three (3) node Proxmox cluster that currently has only local drive.

Using the iSCSI images, we would like to create a shared environment that would allow guest migration between the Proxmox nodes.

That said, I am looking for a preferred method to accomplish this goal.

Each of the each of the Proxmox nodes can see the following:

iscsiadm -m session
tcp: [1] 10.161.100.13:3260,2 iqn.2001-07.com.ceph:1597263662442 (non-flash)
tcp: [2] 10.161.100.11:3260,1 iqn.2001-07.com.ceph:1597263662442 (non-flash)
tcp: [3] 10.161.100.15:3260,3 iqn.2001-07.com.ceph:1597263662442 (non-flash)

multipath -ll
mpath0 (36001405886a0340876340298b0e25efd) dm-0 LIO-ORG,TCMU device
size=2.0T features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=23 status=active
|- 16:0:0:0 sdi 8:128 active ready running
|- 17:0:0:0 sdh 8:112 active ready running
`- 18:0:0:0 sdj 8:144 active ready running

I have tried to attach the shared storage as iSCSI from the Proxmox GUI and it shows up in the storage list. But, the size shows as '0 B'.

I am sure that the issue is in my understanding of the process. Any assistance would be greatly appreciated.

DHM

 

[dietmar]

Why don't you use the ceph storage as ceph? Using iSCSI seems a bad choice too me...

 

[dhmusil]

Thank you for your reply, Dietmar.

I was looking at Cephfs as a solution but when selecting the "content" disk images does not appear to be an option. Is there something I am missing? Also, I assumed there was an overhead using a file based FS vs a block based FS. I am continuing to investigate a test your suggestion. I will post on successes and/or failures.

 

[dietmar]

I was looking at Cephfs as a solution

Why Cephfs? Please note the we have direct support for ceph RBD images - I suggest you use that.

But Cephfs also work if you use it as "Directory" type storage. Just make sure that you enable the required content types in the storage config.