Adaptec AACRAID expose_physicals Kernelbug?!?

MadMakz

New Member
Jan 12, 2020
7
0
1
Moin,

mir ist zufällig aufgefallen das ich die SMART-Werte meiner Festplatten hinter meinen Adaptec Karten neuerdings nicht mehr auslesen kann.

Getestet auf zwei Servern 1x Adaptec 6805T, 1x Adaptec 5405.

Ab wann genau das Problem aufgetreten ist kann ich nicht sagen, aber es funktionierte definitiv noch in der PVE6.x er Serie.

Wenn man expose_physicals von -1 (def) auf 1 setzt funktioniert es, allerdings kann damit das Hostsystem direkt auf die einzelnen Platten schreiben was unter umständen sehr problematisch sein kann.

Ich schätze mal das es ein Kernelbug ist aber da Proxmox ja einen eigenen Kernel mitbringt versuche ich es erst einmal bei euch.

Kernel ist 5.3.13-1-pve

Code:
Module: aacraid
Parameter: aac_convert_sgl --> 1
Parameter: aac_fib_dump --> 0
Parameter: aac_sync_mode --> 0
Parameter: acbsize --> -1
Parameter: aif_timeout --> 120
Parameter: cache --> 2
Parameter: check_interval --> 60
Parameter: check_reset --> 1
Parameter: commit --> -1
Parameter: dacmode --> -1
Parameter: expose_physicals --> -1
Parameter: msi --> 0
Parameter: nondasd --> -1
Parameter: numacb --> -1
Parameter: reset_devices --> 0
Parameter: startup_timeout --> 180
Parameter: update_interval --> 1800
Parameter: wwn --> 1

Weiß da jemand etwas genaures?

TLDR:

Problem:

expose_physicals = -1:
Code:
:~# smartctl -d sat -iA /dev/sg1
smartctl 7.0 2018-12-30 r4883 [x86_64-linux-5.3.13-1-pve] (local build)
Copyright (C) 2002-18, Bruce Allen, Christian Franke, www.smartmontools.org

Smartctl open device: /dev/sg1 [SAT] failed: No such device

expose_physicals = 1:
Code:
:~# smartctl -d sat -iA /dev/sg1
=== START OF INFORMATION SECTION ===
Model Family:     Intel 320 Series SSDs
Device Model:     INTEL SSDSA2CT040G3
Serial Number:    PEPR408201PS040AGN
LU WWN Device Id: 5 5cd2e4 0003e6ef4
Firmware Version: 4PC10362
User Capacity:    40,020,664,320 bytes [40.0 GB]
Sector Size:      512 bytes logical/physical
Rotation Rate:    Solid State Device
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 2.6, 3.0 Gb/s
Local Time is:    Sun Jan 12 12:20:14 2020 CET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
...................
...........
......
 
Last edited:
also entweder die einzelnen disks sind exposed (dann kann smartctl und das restliche system darauf zugreifen) oder nicht (dann nicht ;)). smartctl hat für manche raid controller noch die möglichkeit, den controller nach daten der einzelnen disks zu fragen, viellecht war das in der vergangenheit in verwendung? das wäre dann z.b. -d aacraid,0,0,1 statt -d sat
 
Richtig, allerdings sollte -1 die Disks als Read-Only exposen. So war es auch bisher. Ich versuche es später mit dem Stock-Kernel. Das obige smartctl Kommande nutze ich seit Jahren mit diesen Karten.
 
Hi,

habe das gleiche Problem auch seit dem Update von 5 auf 6...
@MadMakz hast du mal einen Stock Kernel getestet?

Viele Grüße
Christian
 
nichts offensichtliches im treiber code von 5.0 -> 5.3 und 5.3 -> master oder im diff Ubuntu <-> Upstream. eventuell hilft aber ein eingrenzen der noch nicht betroffenen vs. ersten betroffenen Version schon - der Fehler muss ja nicht unbedingt in dem Modul liegen oder offensichtlich sein ;) ein alter Kernel ist ja schnell gebootet und getestet.
 
Controller Adaptec RAID 5405

Das schein wirklich mit dem Update auf 6.x gekommen zu sein.
Ich habe gerade ein Update auf einem einen Server durchgeführt der seit Juli abgeschaltet war.
mit 5.X hab ich die Werte per Cronjob automatisch ausgelesen - das hat also definitiv funktioniert
Vor dem Update hab ich auch noch die Festplatten gecheckt und es funktionierte.
wie bekomme ich da die ganzen Werte wieder angezeigt bzw wo finde ich da eine Beschreibung dafür


arcconf getconfig 1 zeigt die Übersicht des gesamten Raids (Controller information/Logical device information/Physical Device information)

arcconf GETSMARTSTATS 1 funktioniert rudimentär:

Code:
/root/adaptec/arcconf GETSMARTSTATS 1
Controllers found: 1
<SmartStats controllerID="0" time="1618234960" deviceVendor="Adaptec" deviceName="5405" serialNumber="0D371178857">
<PhysicalDriveSmartStats channel="0" id="2" nonSpinning="false" isDescriptionAvailable="false" >
<Attribute id="0x01" normalizedCurrent="200" normalizedWorst="200" rawValue="1" />
<Attribute id="0x03" normalizedCurrent="178" normalizedWorst="172" rawValue="6066" />
<Attribute id="0x04" normalizedCurrent="100" normalizedWorst="100" rawValue="29" />
<Attribute id="0x05" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0x07" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0x09" normalizedCurrent="30" normalizedWorst="30" rawValue="51189" />
<Attribute id="0x0A" normalizedCurrent="100" normalizedWorst="253" rawValue="0" />
<Attribute id="0x0B" normalizedCurrent="100" normalizedWorst="253" rawValue="0" />
<Attribute id="0x0C" normalizedCurrent="100" normalizedWorst="100" rawValue="27" />
<Attribute id="0xC0" normalizedCurrent="200" normalizedWorst="200" rawValue="20" />
<Attribute id="0xC1" normalizedCurrent="1" normalizedWorst="1" rawValue="1380367" />
<Attribute id="0xC2" normalizedCurrent="117" normalizedWorst="106" rawValue="33" />
<Attribute id="0xC4" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0xC5" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0xC6" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0xC7" normalizedCurrent="200" normalizedWorst="199" rawValue="4" />
<Attribute id="0xC8" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
</PhysicalDriveSmartStats>
<PhysicalDriveSmartStats channel="0" id="1" nonSpinning="false" isDescriptionAvailable="false" >
<Attribute id="0x01" normalizedCurrent="200" normalizedWorst="200" rawValue="10" />
<Attribute id="0x03" normalizedCurrent="253" normalizedWorst="253" rawValue="7641" />
<Attribute id="0x04" normalizedCurrent="100" normalizedWorst="100" rawValue="27" />
<Attribute id="0x05" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0x07" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0x09" normalizedCurrent="45" normalizedWorst="45" rawValue="40705" />
<Attribute id="0x0A" normalizedCurrent="100" normalizedWorst="253" rawValue="0" />
<Attribute id="0x0B" normalizedCurrent="100" normalizedWorst="253" rawValue="0" />
<Attribute id="0x0C" normalizedCurrent="100" normalizedWorst="100" rawValue="25" />
<Attribute id="0xC0" normalizedCurrent="200" normalizedWorst="200" rawValue="21" />
<Attribute id="0xC1" normalizedCurrent="200" normalizedWorst="200" rawValue="5" />
<Attribute id="0xC2" normalizedCurrent="116" normalizedWorst="97" rawValue="36" />
<Attribute id="0xC4" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0xC5" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0xC6" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0xC7" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0xC8" normalizedCurrent="200" normalizedWorst="199" rawValue="0" />
</PhysicalDriveSmartStats>
<PhysicalDriveSmartStats channel="0" id="0" nonSpinning="false" isDescriptionAvailable="false" >
<Attribute id="0x01" normalizedCurrent="111" normalizedWorst="99" rawValue="40459744" />
<Attribute id="0x03" normalizedCurrent="93" normalizedWorst="93" rawValue="0" />
<Attribute id="0x04" normalizedCurrent="100" normalizedWorst="100" rawValue="22" />
<Attribute id="0x05" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0x07" normalizedCurrent="65" normalizedWorst="60" rawValue="147642474" />
<Attribute id="0x09" normalizedCurrent="41" normalizedWorst="41" rawValue="52032" />
<Attribute id="0x0A" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0x0C" normalizedCurrent="100" normalizedWorst="100" rawValue="22" />
<Attribute id="0xB7" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xB8" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xBB" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xBC" normalizedCurrent="100" normalizedWorst="97" rawValue="6" />
<Attribute id="0xBD" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xBE" normalizedCurrent="66" normalizedWorst="50" rawValue="572522530" />
<Attribute id="0xBF" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xC0" normalizedCurrent="100" normalizedWorst="100" rawValue="20" />
<Attribute id="0xC1" normalizedCurrent="100" normalizedWorst="100" rawValue="22" />
<Attribute id="0xC2" normalizedCurrent="34" normalizedWorst="50" rawValue="34" />
<Attribute id="0xC3" normalizedCurrent="30" normalizedWorst="10" rawValue="40459744" />
<Attribute id="0xC5" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xC6" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xC7" normalizedCurrent="200" normalizedWorst="200" rawValue="0" />
<Attribute id="0xF0" normalizedCurrent="100" normalizedWorst="253" rawValue="52032" />
<Attribute id="0xF1" normalizedCurrent="100" normalizedWorst="253" rawValue="3211473306" />
<Attribute id="0xF2" normalizedCurrent="100" normalizedWorst="253" rawValue="1955376949" />
</PhysicalDriveSmartStats>
<PhysicalDriveSmartStats channel="0" id="3" nonSpinning="false" isDescriptionAvailable="false" >
<Attribute id="0x01" normalizedCurrent="83" normalizedWorst="63" rawValue="202533663" />
<Attribute id="0x03" normalizedCurrent="94" normalizedWorst="94" rawValue="0" />
<Attribute id="0x04" normalizedCurrent="100" normalizedWorst="100" rawValue="19" />
<Attribute id="0x05" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0x07" normalizedCurrent="95" normalizedWorst="60" rawValue="3256831247" />
<Attribute id="0x09" normalizedCurrent="62" normalizedWorst="62" rawValue="34132" />
<Attribute id="0x0A" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0x0C" normalizedCurrent="100" normalizedWorst="100" rawValue="15" />
<Attribute id="0xB8" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xBB" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xBC" normalizedCurrent="100" normalizedWorst="99" rawValue="2" />
<Attribute id="0xBD" normalizedCurrent="94" normalizedWorst="94" rawValue="6" />
<Attribute id="0xBE" normalizedCurrent="62" normalizedWorst="43" rawValue="639303718" />
<Attribute id="0xBF" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xC0" normalizedCurrent="100" normalizedWorst="100" rawValue="10" />
<Attribute id="0xC1" normalizedCurrent="100" normalizedWorst="100" rawValue="1503" />
<Attribute id="0xC2" normalizedCurrent="38" normalizedWorst="57" rawValue="38" />
<Attribute id="0xC3" normalizedCurrent="33" normalizedWorst="8" rawValue="202533663" />
<Attribute id="0xC5" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xC6" normalizedCurrent="100" normalizedWorst="100" rawValue="0" />
<Attribute id="0xC7" normalizedCurrent="200" normalizedWorst="200" rawValue="1" />
</PhysicalDriveSmartStats>
</SmartStats>


Command completed successfully.
Aber die gesamte Übersicht (/usr/sbin/smartctl -d sat --all /dev/sgX)

wie früher bekomme ich nicht mehr hin z.B:

Code:
smartctl 6.6 2016-05-31 r4324 [x86_64-linux-4.15.18-28-pve] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda 7200.14 (AF)
Device Model:     ST1500DM003-9YN16G
Serial Number:    W1E2XX7T
LU WWN Device Id: 5 000c50 03cdf89c3
Firmware Version: CC4H
User Capacity:    1.500.301.910.016 bytes [1,50 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is:    Wed Sep 16 09:00:03 2020 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
     was never started.
     Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0) The previous self-test routine completed
     without error or no self-test has ever
     been run.
Total time to complete Offline
data collection:   (  584) seconds.
Offline data collection
capabilities:     (0x73) SMART execute Offline immediate.
     Auto Offline data collection on/off support.
     Suspend Offline collection upon new
     command.
     No Offline surface scan supported.
     Self-test supported.
     Conveyance Self-test supported.
     Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
     power-saving mode.
     Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
     General Purpose Logging supported.
Short self-test routine
recommended polling time:   (   1) minutes.
Extended self-test routine
recommended polling time:   ( 169) minutes.
Conveyance self-test routine
recommended polling time:   (   2) minutes.
SCT capabilities:         (0x3085) SCT Status supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED
WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   108   099   006    Pre-fail  Always - 15200872
  3 Spin_Up_Time            0x0003   095   095   000    Pre-fail  Always - 0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always - 19
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always - 536
  7 Seek_Error_Rate         0x000f   072   060   030    Pre-fail  Always - 163824350423
  9 Power_On_Hours          0x0032   041   041   000    Old_age   Always - 51848
10 Spin_Retry_Count         0x0013   100   100   097    Pre-fail  Always - 0
12 Power_Cycle_Count        0x0032   100   100   020    Old_age   Always - 19
183 Runtime_Bad_Block       0x0032   094   094   000    Old_age   Always - 6
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always - 0
187 Reported_Uncorrect      0x0032   092   092   000    Old_age   Always - 8
188 Command_Timeout         0x0032   100   098   000    Old_age   Always - 1 1 6
189 High_Fly_Writes         0x003a   099   099   000    Old_age   Always - 1
190 Airflow_Temperature_Cel 0x0022   065   051   045    Old_age   Always  - 35 (Min/Max 29/39)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always - 0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always - 17
193 Load_Cycle_Count        0x0032   001   001   000    Old_age   Always - 307715
194 Temperature_Celsius     0x0022   035   049   000    Old_age   Always - 35 (0 23 0 0 0)
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always - 0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline - 0
199 UDMA_CRC_Error_Coun...
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!