No SAS2008 after upgrade

L

luckyluk83

Member
Jul 14, 2021
20
4
8
41
Hello All.

I've upgraded from 7 to 8 successfully except one problem. If i use kernel 6.2.16-3-pve it will not detect my SAS2008 hba cards, using 5.15.108-1 is fine.

Can anyone can tell why is that and if there is any way to add drivers to this cards and use newest kernel?
 
Same problem. good old supermicro dual cpu with 256mb RAM servers :-(
as workaround ... booting mit last kernel from pve 7 ...

Base Board Information
Manufacturer: Supermicro
Product Name: X9DRT-HF+
Version: 0123456789
Serial Number: 0123456789
Asset Tag: To be filled by O.E.M.
Features:
Board is a hosting board
Board is replaceable
Location In Chassis: To be filled by O.E.M.
Chassis Handle: 0x0003
Type: Motherboard
Contained Object Handles: 0

lspci -nn -t
| +-03.0-[03]----00.0 Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072]


lsmod |grep -i sas
libsas 98304 1 isci
mpt3sas 323584 6
raid_class 16384 1 mpt3sas
scsi_transport_sas 45056 3 isci,libsas,mpt3sas

uname -a
Linux haxx 5.15.108-1-pve #1 SMP PVE 5.15.108-1 (2023-06-17T09:41Z) x86_64 GNU/Linux
 
Last edited:
Hello.

I can see that in previous kernel they are using mpt2sas and in 6 mpt3sas is used. But i don't know how to implement the needed module or recompile the kernel. I'm trying to researched that but it will take some time.

Thank You for looking in to that as well, maybe there is solution, the problem is that someone have to know to find it.
 
In 7.4 I have 2 LSI cards.
Code: 
lspci |grep SAS
05:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
22:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2116 PCI-Express Fusion-MPT SAS-2 [Meteor] (rev 02)
Both work with the opt-in kernel.
Code: 
Linux pve 6.2.11-2-pve #1 SMP PREEMPT_DYNAMIC PVE 6.2.11-2 (2023-05-10T09:13Z) x86_64 GNU/Linux
For what that is worth.
Will be following this.
Thanks
 
luckyluk83 said:
Hello.

I can see that in previous kernel they are using mpt2sas and in 6 mpt3sas is used. But i don't know how to implement the needed module or recompile the kernel. I'm trying to researched that but it will take some time.

Thank You for looking in to that as well, maybe there is solution, the problem is that someone have to know to find it.
Click to expand...
On kernel 6.2 MPT3SAS replaces MPT2SAS ...
1687880777883.png
 
  • Like
Reactions: luckyluk83 and Dunuin
proxminent said:
On kernel 6.2 MPT3SAS replaces MPT2SAS ...
View attachment 52245
Click to expand...
donhwyo said:
In 7.4 I have 2 LSI cards.
Code: 
lspci |grep SAS
05:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
22:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2116 PCI-Express Fusion-MPT SAS-2 [Meteor] (rev 02)
Both work with the opt-in kernel.
Code: 
Linux pve 6.2.11-2-pve #1 SMP PREEMPT_DYNAMIC PVE 6.2.11-2 (2023-05-10T09:13Z) x86_64 GNU/Linux
For what that is worth.
Will be following this.
Thanks
Click to expand...
So why it is then working with PVE 7.4 + 6.2 kernel but not PVE 8.0 with 6.2 kernel?

I also need to be sure if the SAS2008 cards in my server will continue working before upgrading to PVE 8.
 
Dunuin said:
So why it is then working with PVE 7.4 + 6.2 kernel but not PVE 8.0 with 6.2 kernel?

I also need to be sure if the SAS2008 cards in my server will continue working before upgrading to PVE 8.
Click to expand...
I am in the same boat so I am willing to help if I can. I was having kernel problems with 6.2 so haven't upgraded yet. I installed pve8 as a vm.

On pve7
Code: 
dpkg -l |grep mpt
ii  libopenmpt0:amd64                    0.4.11-1                           amd64        module music library based on OpenMPT -- shared library
ii  mpt-status                           1.2.0-8+hwraid1+Debian.stretch.9.9 amd64        get RAID status out of mpt (and other) HW RAID controllers
Not sure if I installed mpt-status or it was a stock package? Probably dragged forward from pve4. LOL

Tried installing it in the vm.
Code: 
apt install --dry-run mpt-status
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following additional packages will be installed:
  daemon
The following NEW packages will be installed:
  daemon mpt-status
0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded.
Inst daemon (0.8-1+b1 Debian:12.0/stable [amd64])
Inst mpt-status (1.2.0-8+b1 Debian:12.0/stable [amd64])
Conf daemon (0.8-1+b1 Debian:12.0/stable [amd64])
Conf mpt-status (1.2.0-8+b1 Debian:12.0/stable [amd64])
I didn't install because I can't test it.
 
  • Like
Reactions: proxminent
Just install prox v8 on an usb stick and you will see directly that lsi card working. very simple and not touching your <previous, current> install.
 
  • Like
Reactions: Kingneutron
works fine for me with:

03:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS 2008 [Falcon] (rev 03)
05:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)
 
spirit said:
works fine for me with:

03:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS 2008 [Falcon] (rev 03)
05:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)
Click to expand...
PVE 8.0 with 6.2 kernel?
 
Dunuin said:
PVE 8.0 with 6.2 kernel?
Click to expand...
yep
6.2.16-3-pve #1 SMP PREEMPT_DYNAMIC PVE 6.2.16-3 (2023-06-17T05:58Z) x86_64 GNU/Linux

Code: 
[    2.163381] megasas: 07.719.03.00-rc1
[    2.164084] megaraid_sas 0000:03:00.0: BAR:0x1  BAR's base_addr(phys):0x00000000d9ffc000  mapped virt_addr:0x00000000528aff81
[    2.164106] megaraid_sas 0000:03:00.0: FW now in Ready state
[    2.164110] megaraid_sas 0000:03:00.0: 63 bit DMA mask and 32 bit consistent mask
[    2.164604] megaraid_sas 0000:03:00.0: requested/available msix 1/1 poll_queue 0
[    2.164609] megaraid_sas 0000:03:00.0: current msix/online cpus    : (1/8)
[    2.164611] megaraid_sas 0000:03:00.0: RDPQ mode    : (disabled)
[    2.172957] mpt3sas version 43.100.00.00 loaded
[    2.175075] mpt3sas 0000:05:00.0: can't disable ASPM; OS doesn't have ASPM control
[    2.175448] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32848804 kB)
[    2.224866] mpt2sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    2.224876] mpt2sas_cm0: MSI-X vectors supported: 16
[    2.224880] mpt2sas_cm0:  0 8 8
[    2.225211] mpt2sas_cm0: High IOPs queues : disabled
[    2.225215] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 44
[    2.225217] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 45
[    2.225218] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 46
[    2.225220] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 47
[    2.225222] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 48
[    2.225224] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 49
[    2.225226] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 50
[    2.225227] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 51
[    2.225229] mpt2sas_cm0: iomem(0x00000000daff0000), mapped(0x000000008aa19a2f), size(65536)
[    2.225233] mpt2sas_cm0: ioport(0x000000000000ec00), size(256)
[    2.276510] mpt2sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    2.276530] mpt2sas_cm0: sending message unit reset !!
[    2.278048] mpt2sas_cm0: message unit reset: SUCCESS
[    2.301422] megaraid_sas 0000:03:00.0: controller type    : iMR(0MB)
[    2.301430] megaraid_sas 0000:03:00.0: Online Controller Reset(OCR)    : Enabled
[    2.301433] megaraid_sas 0000:03:00.0: Secure JBOD support    : No
[    2.301435] megaraid_sas 0000:03:00.0: NVMe passthru support    : No
[    2.301437] megaraid_sas 0000:03:00.0: FW provided TM TaskAbort/Reset timeout    : 0 secs/0 secs
[    2.301439] megaraid_sas 0000:03:00.0: JBOD sequence map support    : No
[    2.301441] megaraid_sas 0000:03:00.0: PCI Lane Margining support    : No
[    2.301444] megaraid_sas 0000:03:00.0: megasas_init_mfi: fw_support_ieee=67108864
[    2.301476] megaraid_sas 0000:03:00.0: INIT adapter done
[    2.301479] megaraid_sas 0000:03:00.0: JBOD sequence map is disabled megasas_setup_jbod_map 5799
[    2.305414] mpt2sas_cm0: scatter gather: sge_in_main_msg(1), sge_per_chain(9), sge_per_io(128), chains_per_io(15)
[    2.306438] mpt2sas_cm0: request pool(0x00000000ba8c51f7) - dma(0xffc00000): depth(10368), frame_size(128), pool_size(1296 kB)
[    2.357449] megaraid_sas 0000:03:00.0: pci id        : (0x1000)/(0x0073)/(0x1028)/(0x1f51)
[    2.357455] megaraid_sas 0000:03:00.0: unevenspan support    : no
[    2.357458] megaraid_sas 0000:03:00.0: firmware crash dump    : no
[    2.357460] megaraid_sas 0000:03:00.0: JBOD sequence map    : disabled
[    2.357463] megaraid_sas 0000:03:00.0: Max firmware commands: 30 shared with default hw_queues = 1 poll_queues 0
[    2.552116] mpt2sas_cm0: sense pool(0x000000007f7bcde6) - dma(0xfe600000): depth(10107), element_size(96), pool_size (947 kB)
[    2.552654] mpt2sas_cm0: reply pool(0x00000000613f653e) - dma(0xfe400000): depth(10432), frame_size(128), pool_size(1304 kB)
[    2.552693] mpt2sas_cm0: config page(0x000000004609bcd4) - dma(0xfe3ef000): size(512)
[    2.552697] mpt2sas_cm0: Allocated physical memory: size(23840 kB)
[    2.552699] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240)
[    2.552701] mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    2.597442] mpt2sas_cm0: LSISAS2308: FWVersion(15.00.00.00), ChipRevision(0x05), BiosVersion(07.22.01.00)
[    2.597451] mpt2sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
[    2.601615] mpt2sas_cm0: sending port enable !!
[    2.602424] mpt2sas_cm0: hba_port entry: 00000000cd33320d, port: 255 is added to hba_port list
[    2.604064] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b007467950), phys(8)
[    2.604682] mpt2sas_cm0: handle(0x9) sas_address(0x4433221101000000) port_type(0x1)
[    2.604888] mpt2sas_cm0: handle(0xa) sas_address(0x4433221102000000) port_type(0x1)
[    2.605092] mpt2sas_cm0: handle(0xb) sas_address(0x4433221103000000) port_type(0x1)
[    2.621436] mpt2sas_cm0: port enable: SUCCESS
[    2.622428] scsi 1:0:0:0: SATA: handle(0x000b), sas_addr(0x4433221103000000), phy(3), device_name(0x55cd2e404b51f1db)
[    2.624371]  end_device-1:0: add: handle(0x000b), sas_addr(0x4433221103000000)
[    2.625237] scsi 1:0:1:0: SATA: handle(0x0009), sas_addr(0x4433221101000000), phy(1), device_name(0x55cd2e404bc6c9a2)
[    2.627141]  end_device-1:1: add: handle(0x0009), sas_addr(0x4433221101000000)
[    2.628031] scsi 1:0:2:0: SATA: handle(0x000a), sas_addr(0x4433221102000000), phy(2), device_name(0x55cd2e404b51f27e)
[    2.629933]  end_device-1:2: add: handle(0x000a), sas_addr(0x4433221102000000)
 
  • Like
Reactions: Dunuin
LnxBil said:
Please grep in both files for mpt and report back
Click to expand...
cat /boot/config-6.1.10-1-pve | grep -i "mpt"
returns nothing

cat /boot/config-6.2.16-3-pve | grep -i "mpt"
CONFIG_PREEMPT_BUILD=y
# CONFIG_PREEMPT_NONE is not set
CONFIG_PREEMPT_VOLUNTARY=y
# CONFIG_PREEMPT is not set
CONFIG_PREEMPT_COUNT=y
CONFIG_PREEMPTION=y
CONFIG_PREEMPT_DYNAMIC=y
CONFIG_PREEMPT_RCU=y
CONFIG_HAVE_PREEMPT_DYNAMIC=y
CONFIG_HAVE_PREEMPT_DYNAMIC_CALL=y
CONFIG_PREEMPT_NOTIFIERS=y
CONFIG_MPTCP=y
CONFIG_INET_MPTCP_DIAG=m
CONFIG_MPTCP_IPV6=y
CONFIG_CB710_DEBUG_ASSUMPTIONS=y
CONFIG_SCSI_MPT3SAS=m
CONFIG_SCSI_MPT2SAS_MAX_SGE=128
CONFIG_SCSI_MPT3SAS_MAX_SGE=128
CONFIG_SCSI_MPT2SAS=m
CONFIG_DRM_I915_PREEMPT_TIMEOUT=640
CONFIG_DRM_I915_PREEMPT_TIMEOUT_COMPUTE=7500
# CONFIG_DEBUG_PREEMPT is not set
# CONFIG_PREEMPT_TRACER is not set
# CONFIG_PREEMPTIRQ_DELAY_TEST is not set
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom