HPE P408i-p works but is not in lspci

[Gortosch]

Hello everyone,

I have an HPE server with a "P408i-p SR GEN10" Raid Controller. Everything actually works so far. Configured is a 0+1(10) HW Raid.

Filesystem           Type      Size  Used Avail Use% Mounted on
udev                 devtmpfs  126G     0  126G   0% /dev
tmpfs                tmpfs      26G  2.3M   26G   1% /run
/dev/mapper/pve-root ext4       94G  8.8G   81G  10% /
tmpfs                tmpfs     126G   43M  126G   1% /dev/shm
tmpfs                tmpfs     5.0M     0  5.0M   0% /run/lock
efivarfs             efivarfs  496K  228K  264K  47% /sys/firmware/efi/efivars
/dev/sda2            vfat     1022M   12M 1011M   2% /boot/efi
/dev/fuse            fuse      128M   20K  128M   1% /etc/pve
tmpfs                tmpfs      26G     0   26G   0% /run/user/0

/dev/sda3 als LVM.

Compared to an identical system with Hyper-V as a hypervisor, I have much better values in a Windows Server VM. Except for two values, the sequential and random read/write access. The values don't matter at first. Then I wanted to have a look at the detected/loaded controller but cannot find it. Here is the filtered lspci output.

00:00.0 Host bridge: Intel Corporation Sky Lake-E DMI3 Registers (rev 04)
00:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 04)
00:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 04)
00:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 04)
00:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
00:11.0 Unassigned class [ff00]: Intel Corporation C620 Series Chipset Family MROM 0 (rev 09)
00:14.0 USB controller: Intel Corporation C620 Series Chipset Family USB 3.0 xHCI Controller (rev 09)
00:14.2 Signal processing controller: Intel Corporation C620 Series Chipset Family Thermal Subsystem (rev 09)
00:16.0 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #1 (rev 09)
00:16.4 Communication controller: Intel Corporation C620 Series Chipset Family MEI Controller #3 (rev 09)
00:1c.0 PCI bridge: Intel Corporation C620 Series Chipset Family PCI Express Root Port #1 (rev f9)
00:1c.4 PCI bridge: Intel Corporation C620 Series Chipset Family PCI Express Root Port #5 (rev f9)
00:1f.0 ISA bridge: Intel Corporation C621 Series Chipset LPC/eSPI Controller (rev 09)
00:1f.2 Memory controller: Intel Corporation C620 Series Chipset Family Power Management Controller (rev 09)
01:00.0 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Slave Instrumentation & System Support (rev 07)
01:00.1 VGA compatible controller: Matrox Electronics Systems Ltd. MGA G200eH3 (rev 02)
01:00.2 System peripheral: Hewlett-Packard Company Integrated Lights-Out Standard Management Processor Support and Messaging (rev 07)
01:00.4 USB controller: Hewlett-Packard Company iLO5 Virtual USB Controller
02:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
02:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
02:00.2 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
02:00.3 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
11:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 04)
11:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
11:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
11:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
12:00.0 Serial Attached SCSI controller: Adaptec Smart Storage PQI SAS (rev 01)
36:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 04)
36:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 04)
36:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
36:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
36:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
5b:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 04)
5b:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 04)
5b:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
5b:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
5b:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
5b:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
5b:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
5b:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
5b:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
5b:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
5b:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
5b:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
5b:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
5b:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
5b:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
5d:00.0 Network controller: Mellanox Technologies MT27520 Family [ConnectX-3 Pro]
80:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 04)
80:05.2 System peripheral: Intel Corporation Sky Lake-E RAS (rev 04)
80:05.4 PIC: Intel Corporation Sky Lake-E IOAPIC (rev 04)
80:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
80:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
80:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
85:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 04)
85:01.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port B (rev 04)
85:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 04)
85:03.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port D (rev 04)
85:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
85:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
85:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
ae:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 04)
ae:01.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port B (rev 04)
ae:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 04)
ae:03.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port D (rev 04)
ae:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
ae:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
ae:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
d7:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port A (rev 04)
d7:01.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port B (rev 04)
d7:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port C (rev 04)
d7:05.0 System peripheral: Intel Corporation Sky Lake-E VT-d (rev 04)
d7:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
d7:05.4 PIC: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers (rev 04)
d7:0e.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
d7:0e.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
d7:0f.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
d7:0f.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
d7:10.0 Performance counters: Intel Corporation Sky Lake-E KTI 0 (rev 04)
d7:10.1 System peripheral: Intel Corporation Sky Lake-E UPI Registers (rev 04)
d7:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
d7:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
d7:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
d7:12.4 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
d7:12.5 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
d7:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
d7:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
d7:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
d7:17.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)

The only entry that fits would be:

lspci|grep sas -i
12:00.0 Serial Attached SCSI controller: Adaptec Smart Storage PQI SAS (rev 01)

Am I missing a driver? Are there any general recommendations for Proxmox and the HW RAID controller? I would be very happy to receive suggestions and help.

Thank you very much.


Sven

 

[Gortosch]

Hello again,

I'm wondering if it wouldn't make more sense to switch the controller to HBA mode and use a ZFS. As this makes it possible to run replications.

What do you think?


Regards

Sven

 

[PatCas-CSSMV]

Hi, I'm planning to replace esxi 6.7u3 with Proxmox on servers that have same hardware as yours.
HP Gen10 with same raid card.
@sven, or @Gortosch can you tell us what you finally did on your side?

 

[Gortosch]

Hello PatCas-CSSMV,

I have changed the controller to HBA and use ZFS. The system has been running with the maximum possible performance ever since. We are completely happy. Replacing the disks in case of a defective disk in the RAID is a little more time-consuming than with the HW RAID. You should definitely do this beforehand and document it.

Regards
Sven

 

[PatCas-CSSMV]

Thanks for your reply!