[SOLVED] Proxmox - TrueNAs, Disks were not passing to the TrueNas from Proxmox.

[eshrath]

Hello,

I have been able to install Proxmox VE and get a TrueNas VM up and running. However I am facing an issues with the Disks disappearing.

Once the Proxmox starts, I am able to see all my disks (2 - 150 GB disks, 2 - 1 TB disks, 1 - 5 TB disks) under disks section in Proxmox. However once I start TrueNAS all the disks disappears under disks section in Proxmox. TrueNas disk section also doesn't show any disks.

I am running -
Proxmox VE - 7.1-7 on Dell PowerEdge r720.
PCI Control pass through.
IOMMU enabled and verified.
TrueNas Core - TrueNAS-12.0-U8

Any suggestions / help to resolve this help is really appreciated.

Thanks
-Eshrath.

 

[inxsible]

Check your logs and post some detailed information especially dmesg or anything relevant to the disks disappearing. What does it actually mean, they don't show up in the UI or you can no longer access them ?

 

[eshrath]

Inxsible, thanks for your response.

Screenshot 1 - Before TrueNas VM is started -




Screenshot 2 - After TrueNas is started - I no longer see disks under Disks section in Proxmox. Is this expected?



Screenshot 3 - TrueNas also doesn't show any disks.



Proxmox logs - In the attachment section - Filename - ProxMoxVE_Syslog.txt

Proxmox dmesg - In the attachment section - Filename - ProxmoxDmesg.txt

TrueNAS Logs - In the attachment section - Filename - TrueNASLog.txt

 

[Dunuin]

See here: https://forum.proxmox.com/threads/l...emu-pcie-sharing-works-with-5-13-19-3.104252/

 

[eshrath]

Since I could not find a comfortable way to go to back to the previous version of the kernel, I installed the previous version of the Proxmox on the same hard drive. Proxmox Version - 7.0-2 and Proxmox Kernel poe-kernel-5.11:7.0-7

Pverversion--verbose (first tree lines)
proxmox-ve: 7.0-2 (running kernel: 5.11.22-4-pve)
pve-manager: 7.0-11 (running version: 7.0-11/63d82f4e)
pve-kernel-5.11: 7.0-7

After installing Proxmox,
1) I enabled IOMMU
2) Installed TrueNAS
3) Started then TrueNAS and still not able to see the disks pass from the Proxmox to the TrueNas.

Here is the Proxmox syslog.

 

[Dunuin]

Bug is fixed meanwhile with latest kernel update.

 

[Neobin]

From your first screenshot it looks to me, that your disk controller is not in IT-mode?
Something which ZFS and therefore TrueNAS absolutely don't like.

I do not know if TrueNAS performs a check for the IT/IR-mode and maybe hides disks which it can't see/access directly (IT-mode)?

But for ZFS you want your controller in IT-mode anyway. So I personally would flash the firmware to IT-mode and see if this already solves the problem.

Besides all this, have you checked, that the whole pcie-passthrough works for sure?
Do you see the disk controller in the TrueNAS-VM? (lspci in the shell)

Your VM config could also be helpful.

 

[eshrath]

@Dunuin - Latest kernel update did not help. Still the disks are not showing up in NAS.

@Neobin - What attribute / column in the first screenshot indicated the disk controller is not in IT-Mode?

Any pointers on how to flash then firmware to IT-Mode? I believe the flashing is different for different types of controller.

This is what I see in lspci.

root@truenas[~]# lspci
00:00.0 Class 0600: Device 8086:1237 (rev 02)
00:01.0 Class 0601: Device 8086:7000
00:01.1 Class 0101: Device 8086:7010
00:01.2 Class 0c03: Device 8086:7020 (rev 01)
00:01.3 Class 0680: Device 8086:7113 (rev 03)
00:02.0 Class 0300: Device 1234:1111 (rev 02)
00:03.0 Class 00ff: Device 1af4:1002

lspci in Proxmox.

00:00.0 Host bridge: Intel Corporation Xeon E5/Core i7 DMI2 (rev 07)
00:01.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1a (rev 07)
00:02.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2a (rev 07)
00:02.2 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2c (rev 07)
00:03.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3a in PCI Express Mode (rev 07)
00:03.2 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3c (rev 07)
00:05.0 System peripheral: Intel Corporation Xeon E5/Core i7 Address Map, VTd_Misc, System Management (rev 07)
00:05.2 System peripheral: Intel Corporation Xeon E5/Core i7 Control Status and Global Errors (rev 07)
00:11.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Virtual Root Port (rev 05)
00:16.0 Communication controller: Intel Corporation C600/X79 series chipset MEI Controller #1 (rev 05)
00:16.1 Communication controller: Intel Corporation C600/X79 series chipset MEI Controller #2 (rev 05)
00:1a.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #2 (rev 05)
00:1c.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 1 (rev b5)
00:1c.7 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 8 (rev b5)
00:1d.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #1 (rev 05)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5)
00:1f.0 ISA bridge: Intel Corporation C600/X79 series chipset LPC Controller (rev 05)
00:1f.2 SATA controller: Intel Corporation C600/X79 series chipset 6-Port SATA AHCI Controller (rev 05)
01:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10)
01:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10)
01:00.2 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10)
01:00.3 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10)
02:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS 2208 [Thunderbolt] (rev 01)
08:00.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe Switch [PS]
09:00.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe Switch [PS]
09:01.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe Switch [PS]
0a:00.0 PCI bridge: Renesas Technology Corp. SH7757 PCIe-PCI Bridge [PPB]
0b:00.0 VGA compatible controller: Matrox Electronics Systems Ltd. G200eR2
3f:08.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 0 (rev 07)
3f:09.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 1 (rev 07)
3f:0a.0 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 (rev 07)
3f:0a.1 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 (rev 07)
3f:0a.2 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 (rev 07)
3f:0a.3 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 (rev 07)
3f:0b.0 System peripheral: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers (rev 07)
3f:0b.3 System peripheral: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers (rev 07)
3f:0c.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.3 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0c.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 (rev 07)
3f:0c.7 System peripheral: Intel Corporation Xeon E5/Core i7 System Address Decoder (rev 07)
3f:0d.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.3 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
3f:0d.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 (rev 07)
3f:0e.0 System peripheral: Intel Corporation Xeon E5/Core i7 Processor Home Agent (rev 07)
3f:0e.1 Performance counters: Intel Corporation Xeon E5/Core i7 Processor Home Agent Performance Monitoring (rev 07)
3f:0f.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers (rev 07)
3f:0f.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers (rev 07)
3f:0f.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 (rev 07)
3f:0f.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 (rev 07)
3f:0f.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 (rev 07)
3f:0f.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 (rev 07)
3f:0f.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 (rev 07)
3f:10.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 (rev 07)
3f:10.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 (rev 07)
3f:10.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 (rev 07)
3f:10.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 (rev 07)
3f:10.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 (rev 07)
3f:10.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 (rev 07)
3f:10.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 (rev 07)
3f:10.7 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 (rev 07)
3f:11.0 System peripheral: Intel Corporation Xeon E5/Core i7 DDRIO (rev 07)
3f:13.0 System peripheral: Intel Corporation Xeon E5/Core i7 R2PCIe (rev 07)
3f:13.1 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to PCI Express Performance Monitor (rev 07)
3f:13.4 Performance counters: Intel Corporation Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers (rev 07)
3f:13.5 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor (rev 07)
3f:13.6 System peripheral: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor (rev 07)
40:01.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1a (rev 07)
40:02.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2a (rev 07)
40:03.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3a in PCI Express Mode (rev 07)
40:03.2 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3c (rev 07)
40:05.0 System peripheral: Intel Corporation Xeon E5/Core i7 Address Map, VTd_Misc, System Management (rev 07)
40:05.2 System peripheral: Intel Corporation Xeon E5/Core i7 Control Status and Global Errors (rev 07)
41:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
44:00.0 Fibre Channel: QLogic Corp. ISP2532-based 8Gb Fibre Channel to PCI Express HBA (rev 02)
7f:08.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 0 (rev 07)
7f:09.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 1 (rev 07)
7f:0a.0 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 (rev 07)
7f:0a.1 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 (rev 07)
7f:0a.2 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 (rev 07)
7f:0a.3 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 (rev 07)
7f:0b.0 System peripheral: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers (rev 07)
7f:0b.3 System peripheral: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers (rev 07)
7f:0c.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
7f:0c.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
7f:0c.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
7f:0c.3 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
7f:0c.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 (rev 07)
7f:0c.7 System peripheral: Intel Corporation Xeon E5/Core i7 System Address Decoder (rev 07)
7f:0d.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
7f:0d.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
7f:0d.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
7f:0d.3 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07)
7f:0d.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 (rev 07)
7f:0e.0 System peripheral: Intel Corporation Xeon E5/Core i7 Processor Home Agent (rev 07)
7f:0e.1 Performance counters: Intel Corporation Xeon E5/Core i7 Processor Home Agent Performance Monitoring (rev 07)
7f:0f.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers (rev 07)
7f:0f.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers (rev 07)
7f:0f.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 (rev 07)
7f:0f.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 (rev 07)
7f:0f.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 (rev 07)
7f:0f.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 (rev 07)
7f:0f.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 (rev 07)
7f:10.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 (rev 07)
7f:10.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 (rev 07)
7f:10.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 (rev 07)
7f:10.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 (rev 07)
7f:10.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 (rev 07)
7f:10.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 (rev 07)
7f:10.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 (rev 07)
7f:10.7 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 (rev 07)
7f:11.0 System peripheral: Intel Corporation Xeon E5/Core i7 DDRIO (rev 07)
7f:13.0 System peripheral: Intel Corporation Xeon E5/Core i7 R2PCIe (rev 07)
7f:13.1 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to PCI Express Performance Monitor (rev 07)
7f:13.4 Performance counters: Intel Corporation Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers (rev 07)
7f:13.5 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor (rev 07)
7f:13.6 System peripheral: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor (rev 07)

 

[Neobin]

What attribute / column in the first screenshot indicated the disk controller is not in IT-Mode?

The model column. It should show your actual drives (like how it shows your PNY ssd), instead of the controller name/string.

Any pointers on how to flash then firmware to IT-Mode? I believe the flashing is different for different types of controller.

Correct, the flashing procedure differs from type to type. I have no experience with this particular controller, sorry. But google should help you here easyly. It is a common procedure to (cross-)flash these adapters.

This is what I see in lspci.

Sorry, my fault. Under TrueNAS we need pciconf -lv to get the vendor and model names. Please post the output from this again.


Please also provide the output of lspci -s 02:00 -nnk on your Proxmox host, while the TrueNAS-VM is running with the controller passed through.
Also your VM config please: qm config <VMID> on the host. From your screens it should be qm config 100.

 

[eshrath]

The model column. It should show your actual drives (like how it shows your PNY ssd), instead of the controller name/string.



Correct, the flashing procedure differs from type to type. I have no experience with this particular controller, sorry. But google should help you here easyly. It is a common procedure to (cross-)flash these adapters.



Sorry, my fault. Under TrueNAS we need pciconf -lv to get the vendor and model names. Please post the output from this again.

Please also provide the output of lspci -s 02:00 -nnk on your Proxmox host, while the TrueNAS-VM is running with the controller passed through.

root@proxmox:~# lspci -s 02:00 -nnk
02:00.0 RAID bus controller [0104]: Broadcom / LSI MegaRAID SAS 2208 [Thunderbolt] [1000:005b] (rev 01)
        DeviceName: Integrated RAID                         
        Subsystem: Dell PERC H710P Mini (for monolithics) [1028:1f34]
        Kernel driver in use: vfio-pci
        Kernel modules: megaraid_sas
root@proxmox:~#

Also your VM config please: qm config <VMID> on the host. From your screens it should be qm config 100.

root@proxmox:~# qm config 100
balloon: 8192
boot: order=scsi0;ide2;net0
cores: 24
hostpci0: 0000:02:00.0,rombar=0
ide2: none,media=cdrom
memory: 12288
name: TrueNas
net0: virtio=6A:0E:72:15:B6:7C,bridge=vmbr0,firewall=1
numa: 0
ostype: l26
scsi0: local-lvm:vm-100-disk-0,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=bcc36125-7d6a-41e8-9fd1-8a13f1e85866
sockets: 1
vmgenid: 11b1dd9f-813d-45e0-add8-ef2f35c80ea8
root@proxmox:~#

 

[inxsible]

@Neobin is probably correct. megaraid_sas driver is usually reserved for RAID cards.

But the Perc H710P can be reflashed to IT Mode. See here. Just be sure to follow the instructions that are for YOUR card or there is a possibility that you might brick your card.

 

[Neobin]

Your host is using the vfio-pci driver for the controller and we can see the controller in the TrueNAS-VM. So the passthrough seems to work.

Regarding your VM config: For PCIe-passthrough you optimaly want the machine type to be q35 and set the pci device to pci express. You may want to try this out too quickly.

Another thing: Did you already test with rom-bar enabled? You can enable it in the hardware tab of your TrueNAS-VM selecting the pci device (your controller) and edit it. Completely shutdown the vm, enable it and start the vm again. Check if your disks now appear in True-NAS.
With rom-bar enabled you should see the whole controller bios/initialisation on vm startup in the vnc console.

Beside this, I have no other idea than the already said (cross-)flashing to IT-mode. (What you want anyway, if you don't want to use the hardware-raid.)

 

[eshrath]

After a couple of frustrating week in trying to get this setup, I finally got it working and it would have definitely not been possible without the help from this forum.



What I did:

Flashed the PCI card to IT Mode. I followed the guide from https://fohdeesha.com. This guide is comprehensive and I also watched the video of https://www.youtube.com/watch?v=DxyajzBDr9M to get more comfortable in flashing the PCI to the IT mode.

Lessons Learnt:
1) Seeking out help when you tried everything you know. After breaking my head for full week and reinstalling Proxmox and TrueNAS multiple times, I am glad I reached out to this forum for help.
2) Learnt ZFS file system. It looks very good and give a different perspective of how the files should be stored. I will dig in more.
3) Found this awesome forum where members help others and even answer newbie questions and come up with different options to try out.

Big Thanks to @Neobin @inxsible @Dunuin @TorqueWrench @peteb and other members who took time to respond to my questions.


More questions coming up as I explore more.

Thanks again.

 

[eshrath]

Your host is using the vfio-pci driver for the controller and we can see the controller in the TrueNAS-VM. So the passthrough seems to work.

Regarding your VM config: For PCIe-passthrough you optimaly want the machine type to be q35 and set the pci device to pci express. You may want to try this out too quickly.

Before flashing to IT Mode, VM was set to q35, rom-bar enabled.

Another thing: Did you already test with rom-bar enabled? You can enable it in the hardware tab of your TrueNAS-VM selecting the pci device (your controller) and edit it. Completely shutdown the vm, enable it and start the vm again. Check if your disks now appear in True-NAS.
With rom-bar enabled you should see the whole controller bios/initialisation on vm startup in the vnc console.

Beside this, I have no other idea than the already said (cross-)flashing to IT-mode. (What you want anyway, if you don't want to use the hardware-raid.)

 

[Neobin]

Really glad it helped and we could solve the problem.

 

[inxsible]

good stuff !

The fohdeesha tutorials for flashing Perc cards is really awesome if you have one of the Perc cards.

 

[eshrath]

@inxsible @Neobin - After flashing the PERC Card to IT Mode, is there any harm in putting on the battery back in place?

 

[inxsible]

@inxsible @Neobin - After flashing the PERC Card to IT Mode, is there any harm in putting on the battery back in place?

The battery back up is not used when in HBA mode because the caching is not done at the hardware level. I wouldn't put the battery on, if I were you. Sell it off on ebay if you know you are never going to use the card again as a hardware RAID card. Or keep it in storage.

 

[CHawaii]

I have a quick question, just starting out and learning about Proxmox and would like to add Truenas scale soon. Want to add more drives and during my search for cards i came across this thread. How do you know if the card can go into IT mode. i looking to get Febsmart FS-S6-Pro (https://febsmart.com/showproduct.php?id=265), looking at the website site i do not see anything about IT mode but i do see AHCI boot up mode and states it will provide NONE-Raid SATA III ports.

 

[Neobin]

I have a quick question, just starting out and learning about Proxmox and would like to add Truenas scale soon. Want to add more drives and during my search for cards i came across this thread. How do you know if the card can go into IT mode. i looking to get Febsmart FS-S6-Pro (https://febsmart.com/showproduct.php?id=265), looking at the website site i do not see anything about IT mode but i do see AHCI boot up mode and states it will provide NONE-Raid SATA III ports.

I can only highly suggest to not use those cheapish chipsets (ASMedia in this case) and instead use a LSI/Broadcom one, which are well-known working and supported since ages.