H740p mini and SAS Intel SSD PX05SMB040

[Ertu]

Hi everyone,
Happy Christmas

I just put 10x of this SDD drive on my Dell R640 with Perc H740p mini controler.
I tried to put them on eHBA Mode but no way :/
According to Dell, they must be on "non-raid state" before enabling them for a virtual drive

Exemple for Dell site


They are recognizedd by the controller and i can't do anything else.
The controler is on eHBA mode already and the disk are visible but not in non-raid status.

Here is my Idrac screen shot:


The Proxmox side doesn't show them at all ...

Any help will be greatly appreciated
Merry Christmas again

​

btw i can't do a traditionnal raid either..
If i put the controler on raid mode, i don't have the option to create a virtual drive :/

 

[alexskysilk]

Luckily for you, you dont have to be dependent on the firmware controls.

once booted to PVE, install megacli/perccli. from there, you can

/path/to/MegaCli64 -pdlist -a0
/path/to/MegaCli64 -AdpSetProp -EnableJBOD 1 -a0
/path/to/MegaCli64 -pdmakegood -physdrv [your drives identified in line 1] -force –a0
/path/to/MegaCli64 -pdmakejbod -physdrv [your drives identified in line 1] –a0

perccli syntax is different but the sequence will be the same. if you dont know where to get the tools, see https://gist.github.com/metajiji/cf859a7fc65a63690ecb208d11ea8407 or https://www.helotu.com/2023/05/22/install-perccli-on-debian-proxmox/

 

[Ertu]

Thanks will try this tomorrow you are awesome

 

[Ertu]

Hi got this error
root@px5:/# /opt/MegaRAID/MegaCli/MegaCli64 -h
/opt/MegaRAID/MegaCli/MegaCli64: error while loading shared libraries: libncurses.so.5: cannot open shared object file: No such file or directory

 

[alexskysilk]

ahh right. ncurses5 is not available to trixie- but the good news is that we dont actually NEED it. we just need to fool the system into thinking we already have it, like so:

apt install -y libncurses6
ln -s /usr/lib/x86_64-linux-gnu/libncurses.so.6 /usr/lib/libncurses.so.5
ln -s /usr/lib/x86_64-linux-gnu/libncurses.so.6 /usr/lib/libtinfo.so.5

 

[Ertu]

Got it to work

root@px5:/# find /usr/lib* -name 'libncurses.so.6'
root@px5:/# ln -s /usr/lib/x86_64-linux-gnu/libncurses.so.6 /usr/lib/libncurses.so.5

Symlink and it's ok

 

[Ertu]

You was too fast for me

 

[Ertu]

Got this and an error :/

root@px5:/# /opt/MegaRAID/MegaCli/MegaCli64 -pdlist -a0

Adapter #0

Enclosure Device ID: 64
Slot Number: 0
Enclosure position: 1
Device Id: 0
WWN: 50000397CC90015F
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2e9390b0 Sectors]
Non Coerced Size: 0 KB [0x2e83cfb4 Sectors]
Coerced Size: 0 KB [0x2e800000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: NA04
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x50000397cc90015d
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: NETAPP X575_TPM4V400AMDNA04A0UET0EE
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :21C (69.80 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 64
Slot Number: 1
Enclosure position: 1
Device Id: 1
WWN: 58CE38EE201BB6D8
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2dd987b9 Sectors]
Non Coerced Size: 0 KB [0x2dc9c6bd Sectors]
Coerced Size: 0 KB [0x2dc80000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: 5806
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x58ce38ee201bb6da
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: TOSHIBA PX05SMB040 58062830A03W18029H1
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :22C (71.60 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 64
Slot Number: 2
Enclosure position: 1
Device Id: 2
WWN: 58CE38EE201BB70C
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2dd987b9 Sectors]
Non Coerced Size: 0 KB [0x2dc9c6bd Sectors]
Coerced Size: 0 KB [0x2dc80000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: 5806
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x58ce38ee201bb70e
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: TOSHIBA PX05SMB040 58062830A04918029H1
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :22C (71.60 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 64
Slot Number: 3
Enclosure position: 1
Device Id: 3
WWN: 58CE38EE201BB6FC
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2dd987b9 Sectors]
Non Coerced Size: 0 KB [0x2dc9c6bd Sectors]
Coerced Size: 0 KB [0x2dc80000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: 5806
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x58ce38ee201bb6fe
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: TOSHIBA PX05SMB040 58062830A04518029H1
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :22C (71.60 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 64
Slot Number: 4
Enclosure position: 1
Device Id: 4
WWN: 58CE38EE201BB708
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2dd987b9 Sectors]
Non Coerced Size: 0 KB [0x2dc9c6bd Sectors]
Coerced Size: 0 KB [0x2dc80000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: 5806
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x58ce38ee201bb70a
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: TOSHIBA PX05SMB040 58062830A04818029H1
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :22C (71.60 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 64
Slot Number: 5
Enclosure position: 1
Device Id: 5
WWN: 58CE38EE201BB704
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2dd987b9 Sectors]
Non Coerced Size: 0 KB [0x2dc9c6bd Sectors]
Coerced Size: 0 KB [0x2dc80000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: 5806
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x58ce38ee201bb706
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: TOSHIBA PX05SMB040 58062830A04718029H1
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :22C (71.60 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 64
Slot Number: 6
Enclosure position: 1
Device Id: 6
WWN: 58CE38EE201BB6D4
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2dd987b9 Sectors]
Non Coerced Size: 0 KB [0x2dc9c6bd Sectors]
Coerced Size: 0 KB [0x2dc80000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: 5806
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x58ce38ee201bb6d6
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: TOSHIBA PX05SMB040 58062830A03V18029H1
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :22C (71.60 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 64
Slot Number: 7
Enclosure position: 1
Device Id: 7
WWN: 58CE38EE201BB700
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2dd987b9 Sectors]
Non Coerced Size: 0 KB [0x2dc9c6bd Sectors]
Coerced Size: 0 KB [0x2dc80000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: 5806
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x58ce38ee201bb702
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: TOSHIBA PX05SMB040 58062830A04618029H1
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :21C (69.80 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 64
Slot Number: 8
Enclosure position: 1
Device Id: 8
WWN: 58CE38EE201BB710
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2dd987b9 Sectors]
Non Coerced Size: 0 KB [0x2dc9c6bd Sectors]
Coerced Size: 0 KB [0x2dc80000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: 5806
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x58ce38ee201bb712
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: TOSHIBA PX05SMB040 58062830A04A18029H1
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :21C (69.80 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 64
Slot Number: 9
Enclosure position: 1
Device Id: 9
WWN: 58CE38EE201B94EC
Sequence Number: 1
Media Error Count: 0
Other Error Count: 2
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 0 KB [0x2dd987b9 Sectors]
Non Coerced Size: 0 KB [0x2dc9c6bd Sectors]
Coerced Size: 0 KB [0x2dc80000 Sectors]
Sector Size: 520
Firmware state: Unconfigured(good), Spun Up
Device Firmware Level: 5806
Shield Counter: 0
Successful diagnostics completion on : N/A
SAS Address(0): 0x58ce38ee201b94ee
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: TOSHIBA PX05SMB040 58062830A00B18029H1
FDE Capable: Not Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: Unknown
Link Speed: Unknown
Media Type: Hard Disk Device
Drive: Not Supported
Drive Temperature :22C (71.60 F)
PI Eligibility: No
Drive is formatted for PI information: No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: Unknown
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No




Exit Code: 0x00
root@px5:/# /opt/MegaRAID/MegaCli/MegaCli64 -AdpSetProp -EnableJBOD 1 -a0

Adapter 0: Failed to Set Adapter Properties.

Exit Code: 0x01

 

[alexskysilk]

that step might not be necessary for your specific controller; PERC cards can serve raid and jbod simultaneously.

 

[Ertu]

What is the drive ID i should insert ?
/path/to/MegaCli64 -pdmakegood -physdrv [your drives identified in line 1] -force –a0
0 then 1 then 2 etc .. ?

 

[alexskysilk]

if you intend to use this in production, I suggest you spend some time familiarizing yourself with the tool (megacli.) there are many resources online for that.

To answer your specific question, megacli expects enclosure:slot, so your command will be:
/path/to/MegaCli64 -pdmakegood -physdrv [64:0,64:1,64:2...64:9] -force –a0

but seeing how your drives are already in that state you can probably skip that step anyway.

 

[Ertu]

OK Thanks for all your help but afetr this step there is nothing ??
And i can't see anydrive in Proxmox

 

[alexskysilk]

you missed a step.

 

[Ertu]

Tried the last command anyway and another error :/
Adapter: 0: Failed to change PD state at EnclId-64 SlotId-0.

 

[Ertu]

Damn

 

[alexskysilk]

what about the rest of the devices?

if none worked, time to see to firmware updates (run lifecycle) and/or call dell support.

 

[Ertu]

root@px5:/# /opt/MegaRAID/MegaCli/MegaCli64 -pdmakejbod -physdrv [64:0,64:1,64:2,64:3,64:4,64:5,64:6,64:7,64:8,64:9] –a0

Adapter: 0: Failed to change PD state at EnclId-64 SlotId-0.

Exit Code: 0x01

 

[Ertu]

The drive may be not compatible ?

 

[alexskysilk]

I just noticed this little bit for the drive in slot 0

Sector Size: 520

you will need to reformat this disk before you can use it. its possible that the controller firmware will not let you map it until you do; so you will need to plug the drive into a real HBA, use sgdisk to reformat to 512b sector size, and then you can use it.

 

[Ertu]

Oh
Any linux command to do this instead of unplugging all of them and finding a HBA controler card
They are all at 520 ..