CEPH Error and OSD issues

T

TheChimChim

Member
Apr 14, 2022
10
1
8
Hey all,

I have a node that for some reason thinks both SSD's that I have for Ceph are bad. I have removed them from the case and tested them both in Crystal disk and they back as 100%. One of the drives was a OSD disk and while Ceph says that the disk is not an OSD anymore the disk says that it still is. What should I do?
 
TheChimChim said:
I have a node that for some reason thinks both SSD's that I have for Ceph are bad.
Click to expand...
How exactly did you determine that or where does it say it?
TheChimChim said:
One of the drives was a OSD disk and while Ceph says that the disk is not an OSD anymore the disk says that it still is. What should I do?
Click to expand...
Since you've already simply pulled out the OSD and slapped it on Windows, I assume you don't care about the data on it? If yes, then simply wipe it and insert it again as OSD.
 
See the photo below on how I thought it was saying my drives were bad. The Data is not an issue for me being a learning environment for me I can always replace what every I lose. Just curious as why it just stopped working. I know my drives are on the older side but still should be an issue IMO.

1701544576885.png
 
Please use the shell and post a complete excerpt of it here in the code tag.
 
Says failure in less than 24 hours but I dont understand how CrystalDisk showed 100% and this says Failed...

Code: 
smartctl 7.3 2022-02-28 r5338 [x86_64-linux-6.5.11-6-pve] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Device Model:     Corsair Neutron XT SSD
Serial Number:    15368193000102600038
Firmware Version: SAFC01.1
User Capacity:    960,197,124,096 bytes [960 GB]
Sector Size:      512 bytes logical/physical
Rotation Rate:    Solid State Device
Form Factor:      2.5 inches
TRIM Command:     Available, deterministic, zeroed
Device is:        Not in smartctl database 7.3/5319
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sat Dec  2 15:50:42 2023 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: FAILED!
Drive failure expected in less than 24 hours. SAVE ALL DATA.
No failed Attributes found.

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      (  16) The self-test routine was aborted by
                                        the host.
Total time to complete Offline
data collection:                (   30) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   2) minutes.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000b   100   100   050    Pre-fail  Always       -       0
  5 Reallocated_Sector_Ct   0x0013   100   100   050    Pre-fail  Always       -       0
  9 Power_On_Hours          0x0012   100   100   000    Old_age   Always       -       4986
 12 Power_Cycle_Count       0x0012   100   100   000    Old_age   Always       -       227
162 Unknown_Attribute       0x0003   100   100   000    Pre-fail  Always       -       2145
170 Unknown_Attribute       0x0002   100   100   000    Old_age   Always       -       0
172 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       0
173 Unknown_Attribute       0x0012   100   100   000    Old_age   Always       -       655499
174 Unknown_Attribute       0x0012   100   100   000    Old_age   Always       -       175
181 Program_Fail_Cnt_Total  0x0012   100   100   000    Old_age   Always       -       0
187 Reported_Uncorrect      0x0012   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0012   100   100   000    Old_age   Always       -       175
194 Temperature_Celsius     0x0023   070   070   030    Pre-fail  Always       -       30 (Min/Max 29/30)
196 Reallocated_Event_Count 0x0002   100   100   010    Old_age   Always       -       0
218 Unknown_Attribute       0x000b   100   100   050    Pre-fail  Always       -       0
231 Unknown_SSD_Attribute   0x0013   100   100   000    Pre-fail  Always       -       100
241 Total_LBAs_Written      0x0012   100   100   000    Old_age   Always       -       4089
242 Total_LBAs_Read         0x0012   100   100   000    Old_age   Always       -       13028

Read SMART Log Directory failed: scsi error badly formed scsi parameters

Read SMART Error Log failed: scsi error badly formed scsi parameters

Read SMART Self-test Log failed: scsi error badly formed scsi parameters

Read SMART Selective Self-test Log failed: scsi error badly formed scsi parameters
Code: 
smartctl 7.3 2022-02-28 r5338 [x86_64-linux-6.5.11-6-pve] (local build)
Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Device Model:     Corsair Neutron XT SSD
Serial Number:    15368193000102600050
Firmware Version: SAFC01.1
User Capacity:    960,197,124,096 bytes [960 GB]
Sector Size:      512 bytes logical/physical
Rotation Rate:    Solid State Device
Form Factor:      2.5 inches
TRIM Command:     Available, deterministic, zeroed
Device is:        Not in smartctl database 7.3/5319
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sat Dec  2 15:51:18 2023 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: FAILED!
Drive failure expected in less than 24 hours. SAVE ALL DATA.
No failed Attributes found.

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      (  16) The self-test routine was aborted by
                                        the host.
Total time to complete Offline
data collection:                (   30) seconds.
Offline data collection
capabilities:                    (0x5b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        No Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        (   2) minutes.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000b   100   100   050    Pre-fail  Always       -       0
  5 Reallocated_Sector_Ct   0x0013   100   100   050    Pre-fail  Always       -       0
  9 Power_On_Hours          0x0012   100   100   000    Old_age   Always       -       4530
 12 Power_Cycle_Count       0x0012   100   100   000    Old_age   Always       -       137
162 Unknown_Attribute       0x0003   100   100   000    Pre-fail  Always       -       3555
170 Unknown_Attribute       0x0002   100   100   000    Old_age   Always       -       0
172 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       0
173 Unknown_Attribute       0x0012   100   100   000    Old_age   Always       -       589929
174 Unknown_Attribute       0x0012   100   100   000    Old_age   Always       -       113
181 Program_Fail_Cnt_Total  0x0012   100   100   000    Old_age   Always       -       0
187 Reported_Uncorrect      0x0012   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0012   100   100   000    Old_age   Always       -       113
194 Temperature_Celsius     0x0023   070   070   030    Pre-fail  Always       -       30 (Min/Max 29/30)
196 Reallocated_Event_Count 0x0002   100   100   010    Old_age   Always       -       0
218 Unknown_Attribute       0x000b   100   100   050    Pre-fail  Always       -       1
231 Unknown_SSD_Attribute   0x0013   100   100   000    Pre-fail  Always       -       100
241 Total_LBAs_Written      0x0012   100   100   000    Old_age   Always       -       5417
242 Total_LBAs_Read         0x0012   100   100   000    Old_age   Always       -       23116

Read SMART Log Directory failed: scsi error badly formed scsi parameters

Read SMART Error Log failed: scsi error badly formed scsi parameters

Read SMART Self-test Log failed: scsi error badly formed scsi parameters

Read SMART Selective Self-test Log failed: scsi error badly formed scsi parameters
 
If you google your model you will find some similar reports. As a rule, it always says send it back to the manufacturer. Your warranty has apparently expired?

From the other values it doesn't seem to me that this is actually defective. I wouldn't continue to use an SSD that doesn't report the correct SMART values.
You shouldn't use consumer disks for CEPH anyway, it reduces the overall performance to such an extent that CEPH is no fun.

You should see if you can update the firmware. Then I would simply zero the disks completely (preferably with the manufacturer's tool, if available) and then put them back into the server. Maybe do a short SMART test and see if the situation can be solved with that.

Otherwise, it's up to you whether you want to continue using them or not. As I said, it doesn't seem to me that these are actually defective.
 
Warranty would be long up since they were hand me downs. I will look at up dating the firmware and see if I can get them back. If not guess I will have to pick up a new pair of drives. Thanks for the help.
 
Just an update my drives are indeed bad. Both no longer initialize in Windows or any other OS. and will not update the firmware with Corsairs Toolbox.
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom