Hi all, first off, I'm a noob and gradually learning this stuff, so thank you ahead of time for your patience and help with getting me through this
Secondly, I promise I've spent days researching the answers myself before creating this thread. I've followed the guides, the official docs and I just can't figure it out for the life of me
What is the goal:
I've got Proxmox v8 installed with TrueNAS Scale running as a VM. I'm trying to get my 4 HDD's on TrueNAS to setup RAID 0.
What is the setup:
I ordered this HBA from Ebay LSI 9220-8i which apparently comes set up already in IT-mode
I have an ASRock x570 Phantom Gaming 4 mobo and a AMD ryzen 7 5700G 8-core 16 thread processor
What is the issue:
1) Once I set IOMMU to enabled in BIOS (Advanced --> AMD CBS --> NBIO --> IOMMU), I save and exit (F10) and then the system does a boot, then stops and boots again which I believe sets IOMMU to disabled in bios (Do I update BIOS? Don't want to if I don't have to cause of obvious risks)
2) I can't see the HBA in the boot menu options if I want to boot to it directly
3) when I load into Proxmox I can see IOMMU groups and devices but not the HBA
Further info:
Again, thank you for the help and advice in advance
Secondly, I promise I've spent days researching the answers myself before creating this thread. I've followed the guides, the official docs and I just can't figure it out for the life of me
What is the goal:
I've got Proxmox v8 installed with TrueNAS Scale running as a VM. I'm trying to get my 4 HDD's on TrueNAS to setup RAID 0.
What is the setup:
I ordered this HBA from Ebay LSI 9220-8i which apparently comes set up already in IT-mode
I have an ASRock x570 Phantom Gaming 4 mobo and a AMD ryzen 7 5700G 8-core 16 thread processor
What is the issue:
1) Once I set IOMMU to enabled in BIOS (Advanced --> AMD CBS --> NBIO --> IOMMU), I save and exit (F10) and then the system does a boot, then stops and boots again which I believe sets IOMMU to disabled in bios (Do I update BIOS? Don't want to if I don't have to cause of obvious risks)
2) I can't see the HBA in the boot menu options if I want to boot to it directly
3) when I load into Proxmox I can see IOMMU groups and devices but not the HBA
Further info:
Code:
root@main:~# dmesg | grep -e DMAR -e IOMMU -e AMD-Vi
[ 0.046645] AMD-Vi: Unknown option - 'on'
[ 0.116724] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR0, rdevid:160
[ 0.116725] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR1, rdevid:160
[ 0.116726] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR2, rdevid:160
[ 0.116728] AMD-Vi: ivrs, add hid:AMDI0020, uid:\_SB.FUR3, rdevid:160
[ 0.116728] AMD-Vi: Using global IVHD EFR:0x206d73ef22254ade, EFR2:0x0
[ 0.345572] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[ 0.346519] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[ 0.346520] AMD-Vi: Extended features (0x206d73ef22254ade, 0x0): PPR X2APIC NX GT IA GA PC GA_vAPIC
[ 0.346524] AMD-Vi: Interrupt remapping enabled
[ 0.346525] AMD-Vi: X2APIC enabled
[ 0.414376] AMD-Vi: Virtual APIC enabled
[ 0.414654] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
[ 10.321926] AMD-Vi: AMD IOMMUv2 loaded and initialized
Code:
root@main:~# lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne IOMMU
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge
00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne PCIe GPP Bridge
00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus
00:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 51)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Cezanne Data Fabric; Function 7
01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse Switch Upstream
02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
02:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
02:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
02:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
03:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
04:00.1 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
04:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
05:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
06:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
07:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Cezanne [Radeon Vega Series / Radeon Vega Mobile Series] (rev c8)
07:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Renoir Radeon High Definition Audio Controller
07:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor
07:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1
07:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Renoir/Cezanne USB 3.1
07:00.6 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller
08:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 81)
08:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 81)
Code:
root@main:~# nano /etc/default/grub
GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`
GRUB_CMDLINE_LINUX_DEFAULT="quiet iommu=pt"
GRUB_CMDLINE_LINUX=""
Code:
root@main:~# cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-6.2.16-3-pve root=/dev/mapper/pve-root ro quiet iommu=pt
Code:
root@main:~# lsmod | grep vfio
vfio_pci 16384 0
vfio_pci_core 94208 1 vfio_pci
irqbypass 16384 23 vfio_pci_core,kvm
vfio_iommu_type1 49152 0
vfio 57344 3 vfio_pci_core,vfio_iommu_type1,vfio_pci
iommufd 73728 1 vfioAgain, thank you for the help and advice in advance
