Poweredge T610 HDD light not on after sg-format.

daves_nt_here

Member
Dec 27, 2021
13
2
6
49
I bought 8 2tb drives off eBay, they had type 2 protection on them so I sg_format -v -F /dev/sdX and removed the protection on all the drives.
They all show up in Proxmox and I can make a ZFS pool and write to the pool without any issues.

During the sg-format of /dev/sdd, the power blinked out for a second. The T610 was on my bench top while I setup the machine and was not on battery backup. :(

After booting the machine back up and restarting the sg_format on that drive, the HDD light will blink on during self test and when read/write ops are happening but it will not stay on when idle like the other 7 drives.

Everything else seems ok. Should I keep investigating or just ignore it.

This is the drive in question, /dev/sdd.
Below this code block is another drive from the 8 I bought that is working properly, /dev/sde

Code:
root@pve:~# smartctl -x /dev/sdd
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.15.131-2-pve] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               IBM-D050
Product:              ST2000NX0263
Revision:             BD4D
Compliance:           SPC-4
User Capacity:        2,000,398,934,016 bytes [2.00 TB]
Logical block size:   4096 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          2.5 inches
Logical Unit id:      0x5000c500b860642f
Serial number:        W461BTAD0000E841JMR9
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Wed Jan 10 07:36:59 2024 EST
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled
Read Cache is:        Enabled
Writeback Cache is:   Disabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Grown defects during certification = 0
Total blocks reassigned during format = 0
Total new blocks reassigned = 0
Power on minutes since format = 833
Current Drive Temperature:     35 C
Drive Trip Temperature:        65 C

Elements in grown defect list: 0

Error counter log:
           Errors Corrected by           Total   Correction Gigabytes    Total
               ECC          rereads/    errors   algorithm processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:   2851836772        0         0  2851836772          0 291215.743           0
write:         0        0         0         0          0 143605.909           0
verify: 1928732332        0         0  1928732332          0 2215.588           0

Non-medium error count:      608

SMART Self-test log
Num  Test              Status                 segment  LifeTime LBA_first_err [SK ASC ASQ]
     Description                              number   (hours)
# 1  Background short  Completed                   - 0                 - [-   -    -]

Long (extended) Self-test duration: 20400 seconds [340.0 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
    Accumulated power on time, hours:minutes 34689:44 [2081384 minutes]
    Number of background scans performed: 216,  scan progress: 0.00%
    Number of background medium scans performed: 216

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 0
  number of phys = 1
  phy identifier = 0
    attached device type: SAS or SATA device
    attached reason: unknown
    reason: unknown
    negotiated logical link rate: phy enabled; 6 Gbps
    attached initiator port: ssp=1 stp=1 smp=1
    attached target port: ssp=0 stp=0 smp=0
    SAS address = 0x5000c500b860642d
    attached SAS address = 0x5d4ae520ac07d993
    attached phy identifier = 1
    Invalid DWORD count = 8
    Running disparity error count = 8
    Loss of DWORD synchronization = 11
    Phy reset problem = 0
    Phy event descriptors:
     Invalid word count: 8
     Running disparity error count: 8
     Loss of dword synchronization count: 11
     Phy reset problem count: 0
relative target port id = 2
  generation code = 0
  number of phys = 1
  phy identifier = 1
    attached device type: no device attached
    attached reason: unknown
    reason: unknown
    negotiated logical link rate: phy enabled; unknown
    attached initiator port: ssp=0 stp=0 smp=0
    attached target port: ssp=0 stp=0 smp=0
    SAS address = 0x5000c500b860642e
    attached SAS address = 0x0
    attached phy identifier = 0
    Invalid DWORD count = 0
    Running disparity error count = 0
    Loss of DWORD synchronization = 0
    Phy reset problem = 0
    Phy event descriptors:
     Invalid word count: 0
     Running disparity error count: 0
     Loss of dword synchronization count: 0
     Phy reset problem count: 0

Code:
root@pve:~# smartctl -x /dev/sde
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.15.131-2-pve] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               IBM-D050
Product:              ST2000NX0263
Revision:             BD4D
Compliance:           SPC-4
User Capacity:        2,000,398,934,016 bytes [2.00 TB]
Logical block size:   4096 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          2.5 inches
Logical Unit id:      0x5000c500b860581f
Serial number:        W461BS5B0000E84200DS
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Wed Jan 10 07:38:09 2024 EST
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled
Read Cache is:        Enabled
Writeback Cache is:   Disabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Grown defects during certification = 0
Total blocks reassigned during format = 0
Total new blocks reassigned = 0
Power on minutes since format = 2896
Current Drive Temperature:     34 C
Drive Trip Temperature:        65 C

Elements in grown defect list: 0

Error counter log:
           Errors Corrected by           Total   Correction Gigabytes    Total
               ECC          rereads/    errors   algorithm processed    uncorrected
           fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:   123644058        0         0  123644058          0 302089.360           0
write:         0        0         0         0          0 141515.484           0
verify: 1889425582        0         0  1889425582          0 2205.915           0

Non-medium error count:        2

SMART Self-test log
Num  Test              Status                 segment  LifeTime LBA_first_err [SK ASC ASQ]
     Description                              number   (hours)
# 1  Background short  Completed                   - 0                 - [-   -    -]

Long (extended) Self-test duration: 20400 seconds [340.0 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
    Accumulated power on time, hours:minutes 34689:10 [2081350 minutes]
    Number of background scans performed: 215,  scan progress: 0.00%
    Number of background medium scans performed: 215

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 0
  number of phys = 1
  phy identifier = 0
    attached device type: SAS or SATA device
    attached reason: unknown
    reason: unknown
    negotiated logical link rate: phy enabled; 6 Gbps
    attached initiator port: ssp=1 stp=1 smp=1
    attached target port: ssp=0 stp=0 smp=0
    SAS address = 0x5000c500b860581d
    attached SAS address = 0x5d4ae520ac07d994
    attached phy identifier = 2
    Invalid DWORD count = 0
    Running disparity error count = 0
    Loss of DWORD synchronization = 2
    Phy reset problem = 0
    Phy event descriptors:
     Invalid word count: 0
     Running disparity error count: 0
     Loss of dword synchronization count: 2
     Phy reset problem count: 0
relative target port id = 2
  generation code = 0
  number of phys = 1
  phy identifier = 1
    attached device type: no device attached
    attached reason: unknown
    reason: unknown
    negotiated logical link rate: phy enabled; unknown
    attached initiator port: ssp=0 stp=0 smp=0
    attached target port: ssp=0 stp=0 smp=0
    SAS address = 0x5000c500b860581e
    attached SAS address = 0x0
    attached phy identifier = 0
    Invalid DWORD count = 0
    Running disparity error count = 0
    Loss of DWORD synchronization = 0
    Phy reset problem = 0
    Phy event descriptors:
     Invalid word count: 0
     Running disparity error count: 0
     Loss of dword synchronization count: 0
     Phy reset problem count: 0
 
Last edited:
Figured it out after many hours of googling.

SAS HDD Activity LED always on - Ready LED Meaning bit:
https://www.hddoracle.com/viewtopic.php?p=279

And for anyone else who stumbles upon this post with the same issue, here are the steps I did to get the drive light back on.

apt install -y sdparm
sdparm --clear=RLM --save /dev/sdX
Poweroff machine to fully reset HDD
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!