Search results for query: hba truenas passthrough

Check your IOMMU groups. That HBA is probaly sharing an IOMMU group with some important onboard devices and as you can only passthrough all devices of the same IOMMU group at a time (which are then not available anylonger to the host). Check output of pvesh get /nodes/{nodename}/hardware/pci...

Hey just FYI I was have all kinds of problems with my server build trying to get TrueNAS scale working as a VM in Proxmox and getting the HBA to passthrough. Not sure if this will help you but one of the major problems was that when I had physically built the server I had 6 HDDs intended for my...

Edit: Not the PCIe-passthrough is the culprit, but the: hugepages: 1024; most likely in combination with root on ZFS, see: https://forum.proxmox.com/threads/vms-with-pcie-passthrough-do-not-start-anymore-on-pve-kernel-6-5.136741/post-606900 (Changed the thread title accordingly.) /E As...

Both of my VMs with PCIe-passthrough (which run perfectly fine on all the 6.2 kernels) can not start anymore on the 6.5 kernel. :( One of them, as an example:

Hello, I have two dell servers, a R730XD and a R720XD both with quad SFP 10Gb/s ports connect to a single Cisco Nexus 3172T on two QSFP+ ports. The 4 ports on each server are placed in a LAG doing LACP and hashed at layer2+3. The Cisco port channel is a trunk carrying the same vlans to each...

Yes, thats why you usually buy a HBA card to passthrough, so you don't have to passthrough the onboard disk controller where your system disks might be attached to. Or you install PVE on NVMe SSDs that aren'T using the disk controller anyway.

Ah yes I forgot to mention that. I did try wiping from the PVE host itself, That removed some /dev/sdx1 and /dev/sdx2 partitions, but again no luck when trying to create the pool afterwards. Although from the PVE host each disk appears clean.

Did you also try to wipe the disks from the PVE host? Keep in mind that when working without PCI passthrough of a HBA your TrueNAS is always working with virtual disks and not the real physical disks.

Thank you wbk! I tried rescue boot from usb, also no luck :) So installed proxmox from scratch (again), because this system isnt mission critical yet and wont be before i got it working. Have to do back up's this time so i dont have to configure and install everything again. My set up is...

Hi there, I'm doing something quite trivial I have this controller and 4 HDD disks attached to it: root@sofx1010pve3307:~# dmesg |grep 2008 [ 0.256490] DMAR: dmar0: reg_base_addr fed90000 ver 1:0 cap d2008c40660462 ecap f050da [ 3.309755] mpt2sas_cm0: LSISAS2008: FWVersion(20.00.07.00)...

indeed the default lvmthin is great. truenas require zfs and it's for enterprise with integrity requirements, which require datacenter ssd with PLP protection to allow reliability and durability. passthrough disks with cli qemu set /dev/disks/... isn't recommended and you loose flexibility. Only...

Yes, passthing through a HBA is like TrueNAS running bare metal directly accessing the real physical disks. Every OS with ZFS support could import the pool. Not sure how TrueNAS handles ZFS pools not created by TrueNAS. Best you ask that in their community forum. When passing through...

Thats an option. But ZFS got terrible overhead and overhead isn't adding up but multiplying (so exponential growth). So it's not a good idea to run ZFS on top of ZFS and ZFS is want you need for TrueNAS. So I would either passthrough a whole HBA card (or alternatively individual disks if PCI...

That sounds like a nice low-power home server. Would be interested to hear what the power consumption is when running idle and under load. So hard to find an energy-efficient machine that checks all my requirements like dual NVMe or SATA, quiet, ECC RAM. That's not a lot of RAM for all those...

When using ZFS it's highly recommended to: 1.) not use SMR HDDs (but CMR HDDs and ideally with additional SSDs as "special" vdevs) 2.) not use consumer grade SSDs (but enterprise grade with power-loss protection) So keep that in mind when buying new disks in case you want to make use of TrueNAS...

There is virtualization overhead, as your TrueNAS VM then still is only working with virtual disks that are mapped to physical disks, instead of direct access to the real physical disks you would get with PCI passthrough, but the overhead is quite small. Its more about stuff like that TrueNAS...

Will work but ZFS got terrible overhead and overhead is multiplying and not just adding up. So ZFS on top of ZFS is a bad idea and I personally wouldn't do that. Would only make sense if you want to migrate that VM between nodes where you wouldn't want to have hardware dependencies. Otherwise I...

Yes. Yes, because you avoid nested filesystems as the ext4 and qcow2 would add unneccessary additional overhead. Keep in mind that you: a) can only passthrough whole IOMMU groups, so the HBA needs to be connected to a PCIe port that is directly connected to the CPU and not to the chipset as it...