[SOLVED] Help with LSI Card

kingmartell

New Member
Feb 2, 2022
3
2
3
29
Hey everyone,

Been running Proxmox for a little bit now and have a ZFS pool with 10 hard drives in it. My old LSI card died and I replaced it with an LSI 9206-16e and something strange is going on. When I reboot the server I get an error stating "Allocation Failure during SCSI Scanning". The drives do not show up when I run lsblk, but if I use LSIUtil, the card does show all of the drives. A dmesg | grep mpt looks good and looks like this:
Code:
[    0.008436]   Device   empty
[    1.995532] mpt3sas version 38.100.00.00 loaded
[    1.999494] mpt3sas 0000:03:00.0: can't disable ASPM; OS doesn't have ASPM control
[    1.999955] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (82278064 kB)
[    2.054611] mpt2sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    2.054622] mpt2sas_cm0: MSI-X vectors supported: 1
[    2.054627] mpt2sas_cm0:  0 1
[    2.054709] mpt2sas_cm0: High IOPs queues : disabled
[    2.054711] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 43
[    2.054713] mpt2sas_cm0: iomem(0x0000000092280000), mapped(0x00000000227fe05e), size(16384)
[    2.054718] mpt2sas_cm0: ioport(0x0000000000003000), size(256)
[    2.109707] mpt2sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    2.137092] mpt2sas_cm0: scatter gather: sge_in_main_msg(1), sge_per_chain(9), sge_per_io(128), chains_per_io(15)
[    2.137613] mpt2sas_cm0: request pool(0x000000005dd9f62c) - dma(0x112000000): depth(30127), frame_size(128), pool_size(3765 kB)
[    3.135627] mpt2sas_cm0: sense pool(0x0000000086ff214a) - dma(0x117400000): depth(29868), element_size(96), pool_size (2800 kB)
[    3.135632] mpt2sas_cm0: sense pool(0x0000000086ff214a)- dma(0x117400000): depth(29868),element_size(96), pool_size(0 kB)
[    3.136225] mpt2sas_cm0: reply pool(0x00000000eafe8403) - dma(0x117800000): depth(30191), frame_size(128), pool_size(3773 kB)
[    3.136252] mpt2sas_cm0: config page(0x00000000681e8936) - dma(0x116f33000): size(512)
[    3.136254] mpt2sas_cm0: Allocated physical memory: size(66932 kB)
[    3.136255] mpt2sas_cm0: Current Controller Queue Depth(29865),Max Controller Queue Depth(32455)
[    3.136256] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    3.180218] mpt2sas_cm0: overriding NVDATA EEDPTagMode setting
[    3.180654] mpt2sas_cm0: LSISAS2116: FWVersion(20.00.07.00), ChipRevision(0x02), BiosVersion(07.11.00.00)
[    3.180656] mpt2sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
[    3.182371] mpt2sas_cm0: sending port enable !!
[    4.880198] mpt2sas_cm0: hba_port entry: 0000000056bf8593, port: 255 is added to hba_port list
[    4.883511] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500062b2004a7c40), phys(16)
[    4.893254] mpt2sas_cm0: expander_add: handle(0x0011), parent(0x0001), sas_addr(0x500604806828e13f), phys(25)
[    4.900943] Modules linked in: hid_generic dm_thin_pool usbkbd usbmouse dm_persistent_data dm_bio_prison dm_bufio libcrc32c usbhid hid crc32_pclmul xhci_pci megaraid_sas xhci_pci_renesas lpc_ich tg3 ehci_pci ehci_hcd xhci_hcd mpt3sas raid_class pata_acpi scsi_transport_sas wmi
[    4.900970] Workqueue: fw_event_mpt2sas0 _firmware_event_work [mpt3sas]
[    4.901043]  ? scsih_target_alloc+0x10d/0x330 [mpt3sas]
[    4.901078]  mpt3sas_transport_port_add+0x313/0x4a0 [mpt3sas]
[    4.901090]  _scsih_add_device.constprop.0+0x3fa/0x510 [mpt3sas]
[    4.901102]  _firmware_event_work+0xdff/0x1f60 [mpt3sas]
[    5.233386] mpt2sas_cm0: expander_add: handle(0x001c), parent(0x0002), sas_addr(0x500604806829733f), phys(25)
[   10.478090] mpt2sas_cm0: port enable: SUCCESS
[  813.675762] mptctl: Registered with Fusion MPT base driver
[  813.675762] mptctl: /dev/mptctl @ (major,minor=10,220)
[/ICODE]

Kinda grinding my head against the wall since I do not understand why the card would see the drives and enclosure and mpt isn't reporting anything but lsscsi reports no drives. Any help would be appreciated!
 
That's the weird thing, LSPCI lists it as a raid controller:
Code:
root@proxmox:~# lspci | grep LSI
03:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2116 PCI-Express Fusion-MPT SAS-2 [Meteor] (rev 02)
0a:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS-3 3108 [Invader] (rev 02)
.

This card does not have RAID capabilities so I cannot figure out why it is reading as a raid controller
 
Responding to myself. It seems that upgrading to kernel 5.15 seems to have fixed this problem. If anyone else runs into this try to upgrade your kernel. PVE-Kernel 5.4.151-1-pve was the one that broke this for me. Thanks again everyone
 
I'm hitting the same issue on kernel 5.15.39-1-pve.

$ dmesg | grep mpt2sas_cm0 [ 1.058716] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32471524 kB) [ 1.068129] mpt2sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [ 1.068140] mpt2sas_cm0: MSI-X vectors supported: 1 [ 1.068142] mpt2sas_cm0: 0 1 1 [ 1.068194] mpt2sas_cm0: High IOPs queues : disabled [ 1.068195] mpt2sas_cm0: iomem(0x0000000071cc0000), mapped(0x0000000076a02763), size(16384) [ 1.068197] mpt2sas_cm0: ioport(0x0000000000004000), size(256) [ 1.074523] mpt2sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [ 1.077962] mpt2sas_cm0: scatter gather: sge_in_main_msg(1), sge_per_chain(9), sge_per_io(128), chains_per_io(15) [ 1.077999] mpt2sas_cm0: request pool(0x00000000c5a57866) - dma(0x115080000): depth(3492), frame_size(128), pool_size(436 kB) [ 1.084702] mpt2sas_cm0: sense pool(0x00000000612cdff3) - dma(0x115700000): depth(3367), element_size(96), pool_size (315 kB) [ 1.084704] mpt2sas_cm0: sense pool(0x00000000612cdff3)- dma(0x115700000): depth(3367),element_size(96), pool_size(0 kB) [ 1.084742] mpt2sas_cm0: reply pool(0x00000000a9d81656) - dma(0x115780000): depth(3556), frame_size(128), pool_size(444 kB) [ 1.084744] mpt2sas_cm0: config page(0x0000000093bdfb3e) - dma(0x1156d5000): size(512) [ 1.084745] mpt2sas_cm0: Allocated physical memory: size(7579 kB) [ 1.084746] mpt2sas_cm0: Current Controller Queue Depth(3364),Max Controller Queue Depth(3432) [ 1.084746] mpt2sas_cm0: Scatter Gather Elements per IO(128) [ 1.124430] mpt2sas_cm0: overriding NVDATA EEDPTagMode setting [ 1.124952] mpt2sas_cm0: LSISAS2008: FWVersion(20.00.07.00), ChipRevision(0x03), BiosVersion(07.39.02.00) [ 1.124953] mpt2sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ) [ 1.125394] mpt2sas_cm0: sending port enable !! [ 2.652198] mpt2sas_cm0: hba_port entry: 000000003b9b812f, port: 255 is added to hba_port list [ 2.653776] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x5005076043823ddc), phys(8) [ 2.654397] mpt2sas_cm0: handle(0x9) sas_address(0x4433221100000000) port_type(0x1) [ 3.156388] mpt2sas_cm0: handle(0xa) sas_address(0x4433221101000000) port_type(0x1) [ 3.406181] mpt2sas_cm0: handle(0xb) sas_address(0x4433221102000000) port_type(0x1) [ 3.665677] mpt2sas_cm0: handle(0xc) sas_address(0x4433221103000000) port_type(0x1) [ 8.789973] mpt2sas_cm0: port enable: SUCCESS [ 17.427098] mpt2sas_cm0: log_info(0x30030101): originator(IOP), code(0x03), sub_code(0x0101)

$ sas2ircu 0 DISPLAY LSI Corporation SAS2 IR Configuration Utility. Version 16.00.00.00 (2013.03.01) Copyright (c) 2009-2013 LSI Corporation. All rights reserved. Read configuration has been initiated for controller 0 ------------------------------------------------------------------------ Controller information ------------------------------------------------------------------------ Controller type : SAS2008 BIOS version : 7.39.02.00 Firmware version : 20.00.07.00 Channel description : 1 Serial Attached SCSI Initiator ID : 0 Maximum physical devices : 255 Concurrent commands supported : 3432 Slot : 10 Segment : 0 Bus : 4 Device : 0 Function : 0 RAID Support : No
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!