Suggestions: Proxmox Cluster Passthrough All Hard Disks to Media VM

[vasquezmi]

I have a 3 node cluster of servers (OCT) that each have 4 bays.
I want to maximize my ability to leverage these 12 hard drives as a repository likely backups across this environment.
Each server has these hard drives managed by a S3008 HBA.
I attempted to try ceph but I could not manage to get started as it could not find the drives to create OSDs.

So...I went the route of installing TrueNAS as a VM on one node (Node 3), passed through the drives to the VM and created the ZFS pool.
**This is all new and I am just seating the environment to test. I am open to ripping that apart based upon suggestions.

Ultimately, I would like for viable options, outside of ceph, to run this environment. I could be over-thinking it and it could be as simple as having Proxmox control ZFS on each node and then passing to TrueNAS and then managing datasets there.

But like I said I am open to suggestions.

 

[Anotheruser]

Do you want to combine all three servers to one giant pool or do you want to have three separate pools?

If you want to have one giant pool or other centralized management options, you can install truenas scale on all three servers, pass all disks to the truenas vms (pcle passthrough the entire hba is prefered over individual disks) and then enable sth called truenas command.
This will allow you to cluster all three truenas instances together.

If thats not your usecase, pls explain a bit more detailed what your final goal is.

 

[vasquezmi]

Do you want to combine all three servers to one giant pool or do you want to have three separate pools?

If you want to have one giant pool or other centralized management options, you can install truenas scale on all three servers, pass all disks to the truenas vms (pcle passthrough the entire hba is prefered over individual disks) and then enable sth called truenas command.
This will allow you to cluster all three truenas instances together.

If thats not your usecase, pls explain a bit more detailed what your final goal is.

Thank you for that suggestion! I am open to both options for 1 large pool or 3 separate.

I believe if I go the three separate pool option I could leverage Pool 1 - Operational Pool (Active VMS, User File Share, Other Stuff) Pool 2 - Backups? Pool 3 - Another Use Pool.

One large pool would leave me with single space but I realize there would be backup implications that I would have to consider.

Still I appreciate the quick dialog and will continue the thread to see what others might opine.