Proxmox To TrueNAS via iSCSI

[abulhallaj]

Hi, there
I'm coming for ESXi and vCenter so my question maybe dumb! this is my first promox setup.
Is there any best practice for Connecting Proxmox to TrueNAS via iSCSI?

if no let ask some questions and answer them:

- What's the best LUNing structure?
1- One Big LUN , ONE Big LVM
2- One Big LUN , Multiple LVM
3- Multiple LUNs , One Big LVM
4- Multiple LUNs , One LVM over every LUN

- What's the Best FS in TrueNAS for VM`s Thin partitions via Proxmox?
currently i am o scenario 4 but it did't support qemu hdd, an must use RAW so VM disk are Thick provisioned.

 

[UdoB]

Just posting to make sure you know this: https://pve.proxmox.com/pve-docs/chapter-pvesm.html#_storage_types

Utilizing iSCSI seems to be... difficult, as there are some restrictions, feature-wise.

Disclaimer: I do not use that.

 

[floh8]

Best would be zfs over iscsi, if u do not have a truenas cluster. Another way would be point 4.

 

[bbgeek17]

Hi @abulhallaj ,
The answer to your question depends on a few things:
a) the type of disks in your TrueNAS: hdd vs nvme
b) The structure of your backend (TrueNAS) pool
c) The intended use case in PVE
d) Home vs Business use
likely a few more I am forgetting now.

1- One Big LUN , ONE Big LVM

This would be most common and the simplest approach

2- One Big LUN , Multiple LVM

If your storage appliance runs on HDD or/and has them all in a single RAID of some sort, then it becomes inefficient to parallel-write data over the network to this backend pool with multiple queues.
*If by multiple LVM you mean many PVE storage pools - that also becomes harder to manage with growth.

3- Multiple LUNs , One Big LVM

If your storage appliance already has all the disks in RAID (which it very likely does) you just split it in pieces and glued it into one piece again.

4- Multiple LUNs , One LVM over every LUN

It depends on what you mean by "one LVM per LUN". If you meant PVE storage pool - again that's inefficient and hard to manage day to day.
If you meant LUN>VM Image (disk), this could be your desired approach given the constraints. You can but don't need to use LVM layer.
This option does require extensive manual management for daily disk administration tasks. It also would be the closest approach to ZFS/iSCSI scheme which is directly supported by PVE. If you manage to get it working it would be the "seamless" integration, well suitable for homelab.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[floh8]

I must correct my 2. Sentence. An other way is use multi LUNs with one VG, but multi lvs. Its your point 3, I think.

 

[alexskysilk]

Is there any best practice for Connecting Proxmox to TrueNAS via iSCSI?

Out of curiosity, why limit yourself to iscsi? filestore (NFS) is an option. its simpler to use and performs similarly under many circumstances.