problem proxmox disks I / O error, dev sdb

[Proxmoxgoogle]

Hello

After a power cut, it starts to have failures in one of the proxmox server disks. Proxmox starts but in the proxmox console it shows me these errors

print_req_error i / o error dev sda sector 562581672.

Execute the command "fsck -y / dev / sdb" and it gave me the following error:
/ dev / sdb is in use
e2fsck: can not continue, aborting.

La salida de la consola es

Jun 18 09:47:01 server-ect2 kernel: ata3.00: status: { DRDY ERR }
Jun 18 09:47:01 server-ect2 kernel: ata3.00: error: { UNC }
Jun 18 09:47:01 server-ect2 kernel: ata3.00: configured for UDMA/133
Jun 18 09:47:01 server-ect2 kernel: sd 2:0:0:0: [sdb] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Jun 18 09:47:01 server-ect2 kernel: sd 2:0:0:0: [sdb] tag#0 Sense Key : Medium Error [current]
Jun 18 09:47:01 server-ect2 kernel: sd 2:0:0:0: [sdb] tag#0 Add. Sense: Unrecovered read error - auto reallocate failed
Jun 18 09:47:01 server-ect2 kernel: sd 2:0:0:0: [sdb] tag#0 CDB: Read(10) 28 00 21 88 50 a8 00 00 08 00
Jun 18 09:47:01 server-ect2 kernel: print_req_error: I/O error, dev sdb, sector 562581672
Jun 18 09:47:01 server-ect2 kernel: ata3: EH complete
Jun 18 09:47:01 server-ect2 systemd[1]: Started Proxmox VE replication runner.

Any solution ?

 

[wolfgang]

Hi,

it looks like your disk has taken damage from this outage.
Did you check the smart values?

 

[Proxmoxgoogle]

this is the output of the smart


smartctl -a /dev/sdb
smartctl 6.6 2016-05-31 r4324 [x86_64-linux-4.13.13-2-pve] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family: Western Digital Blue
Device Model: WDC WD10EZEX-00BN5A0
Serial Number: WD-WCC3F1VZEA83
LU WWN Device Id: 5 0014ee 2609ac0c5
Firmware Version: 01.01A01
User Capacity: 1,000,204,886,016 bytes [1.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 7200 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ACS-2, ACS-3 T13/2161-D revision 3b
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Tue Jun 18 10:13:13 2019 -03
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (12000) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off supp ort.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 124) minutes.
Conveyance self-test routine
recommended polling time: ( 5) minutes.
SCT capabilities: (0x3035) SCT Status supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_ FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 217
3 Spin_Up_Time 0x0027 173 173 021 Pre-fail Always - 2341
4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 41
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0
7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0
9 Power_On_Hours 0x0032 076 076 000 Old_age Always - 18046
10 Spin_Retry_Count 0x0032 100 253 000 Old_age Always - 0
11 Calibration_Retry_Count 0x0032 100 253 000 Old_age Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 41
192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 26
193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 210
194 Temperature_Celsius 0x0022 108 099 000 Old_age Always - 35
196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 2
198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 2
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 1

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged. [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

 

[K. de Jong]

here is your problem:

ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_ FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 217
3 Spin_Up_Time 0x0027 173 173 021 Pre-fail Always - 2341

 

[danielb]

I'd rather say the problem is with the Current_Pending_Sector and Offline_Uncorrectable (both being > 0). In any case, /dev/sdb is physically damaged. Data recovery can be anywhere between hard and impossible

 

[Proxmoxgoogle]

So the solution is to change the disk?

 

[danielb]

You need to change the disk yes. No doubt about it

 

[Proxmoxgoogle]

Ok, thanks for helping me