Lenovo SR650 V3 Proxmox Storage slow storage

coreyman2000

New Member
Sep 27, 2025
3
0
1
I have 4 Lenovo SR650 V3 , with 25Gb networking In active / passive

each of the servers have 10 NVME i believe 3tb each,

4 nodes are in a cluster, ive used CEPH storage and ZFSPOOL RAIDZ2 either local or Linbit linstor, doing FIO test getting anywhere from 30 MBs to 500Mbs on the best day, what can i check why the storage is so slow, each NVME drive should Handel like higher than 2000MBS

currently having datacenter power issues so its currently powered down to get any more details at this time.
Cheers,
 
Witch Modell, Name, Production Date?
the full specs of the system i awsome your talking about NVME model?
its a Micon 7450 MAX , the system was procured Jan 2024


7D6NCTO3WW ThinkAgile HX650 V3 Certified Node
8
BRP4ThinkAgile HX650 V3 Base
8
BVGLData Center Environment 30 Degree Celsius / 86 Degree Fahrenheit
8
B0W3XClarity Pro
8
BFT6Nutanix SW Stack on VMware ESXi 7.0 (shipped with AHV and field installable to ESXi 7.0)
8
B0W25 Years
8
B4Z6None (If ThinkAgile Deployment services are not selected, Lenovo strongly recommends that approved business partners perform the deployment)
8
BN9VNone
8
BQ65Intel Xeon Gold 5420+ 28C 205W 2.0GHz Processor
16
BNF9ThinkSystem 64GB TruDDR5 4800MHz (2Rx4) 10x4 RDIMM
128
BH8DThinkSystem 2U/4U 8x2.5" NVMe Backplane
16
B0SWNutanix Flash Node Config
8
BNF5ThinkSystem 2.5" U.3 7450 PRO 3.84TB Read Intensive NVMe PCIe 4.0 x4 HS SSD
80
B8P9ThinkSystem M.2 NVMe 2-Bay RAID Enablement Kit
8
BTTYM.2 NVMe
8
BKSRThinkSystem M.2 7450 PRO 960GB Read Intensive NVMe PCIe 4.0 x4 NHS SSD
16
BN2TThinkSystem Broadcom 57414 10/25GbE SFP28 2-Port OCP Ethernet Adapter
8
BK1HThinkSystem Broadcom 57414 10/25GbE SFP28 2-port PCIe Ethernet Adapter
24
BF10Lenovo Dual Rate 10G/25G SR SFP28 85C Transceiver
64
BLKLThinkSystem V3 2U x16/x8/x8 PCIe Gen4 Riser1 or 2
8
BPK9ThinkSystem 1800W 230V Titanium Hot-Swap Gen2 Power Supply
16
64002.8m, 13A/100-250V, C13 to C14 Jumper Cord
16
B97NThinkSystem Toolless Slide Rail Kit v2 Enhanced with 2U CMA
8
BQQ2ThinkSystem 2U V3 EIA Latch Standard
8
BLL6ThinkSystem 2U V3 Performance Fan Module
48
BPKRTPM 2.0
8
B7Y0Enable IPMI-over-LAN
8
BB0P
8
BLL0ThinkSystem SR650 V3 MB
8
BVMCTrigger MFG to scan the SN from the CPU Board via this MI
8
B6C1Node Cores
448
B6C2Node Tebibytes
280
BHSSMI for PXE with RJ45 Network port
8
 
Last edited:
9220Preload by Hardware Feature Specify
8
5977Select Storage devices - no configured RAID required
8
BRPJXCC Platinum
8
BK15High voltage (200V+)
8
BPK3ThinkSystem WW Lenovo LPK
8
BMPFThinkSystem V3 2U Power Cable from MB to Front 2.5" BP v2
16
BPDXThinkSystem SR650 V3 MCIO8x to SL8x CBL, PCIe4, 8x2.5AnyBay, 160mm
16
BPE3ThinkSystem SR650 V3 MCIO8x to SL8x CBL, PCIe4, 8x2.5AnyBay, 200mm
16
BPE2ThinkSystem SR650 V3 Swift8x to SL8x CBL from SWIFT 4/3 to BP2, 320mm
8
BPE7ThinkSystem SR650 V3 Swift8x to SL8x CBL, PCIe4 PCIe5/6-BP2, 250mm
8
BS6YThinkSystem 2U V3 M.2 Signal & Power Cable, SLx4 with 2X10/1X6 Sideband, 330/267/267mm
8
BE0EN+N Redundancy With Over-Subscription
8
BQ11G4 x16/x8/x8 PCIe Riser BLKL for Riser 1 Placement
8
BQ18G4 x16/x8/x8 PCIe Riser BLKL for Riser 2 Placement
8
ATSBNutanix Solution Code MFG Instruction
8
BTSEThinkAgile HX650 V3 CN
8
BSWKThinkAgile SR650 V3 Agency Label - No CCC
8
B8K8ThinkSystem 2U MS 24x2.5" NVMe HDD Type Label1
16
AVENThinkSystem 1x1 2.5" HDD Filler
48
AVEQThinkSystem 8x1 2.5" HDD Filler
8
BQQ6ThinkSystem 2U V3 EIA right with FIO
8
BXGYRight EIA with FIO assembly
8
B97BXCC Label
8
BQBPThinkSystem MCC CPU Clip
16
BPDRThinkSystem SR850 V3/SR650 V3 Standard Heatsink w/ Heatpipes
16
BP46ThinkSystem 2U Main Air Duct
8
AUTQThinkSystem small Lenovo Label for 24x2.5"/12x3.5"/10x2.5"
8
AURSLenovo ThinkSystem Memory Dummy
128
B986ThinkSystem HV 2U WW General PKG BOM
8
BPD9ThinkSystem 1800W Ti Power rating Label WW
8
BLL3ThinkSystem SR650 V3 PSU Duct
8
BC4XMS 2FH Riser Filler
8
BPKDThinkSystem 2U MS 3FH Riser 1&2 Cage w/Label1
8
BLLDThinkSystem 2U MS 3FH Riser 1&2 Cage w/ lbl2
8
AWF9ThinkSystem Response time Service Label LI
8
BM8TThinkSystem SR650 V3 Firmware and Root of Trust Security Module
8
BU8SThinkAgile HX650 V3 - Nutanix IP
8
BTS5ThinkAgile SR650 V3 Service Label - WW
8
BENNHX First Power-On Label
8
B0SQHX Badge 1
8
BSJ8ThinkAgile EIA Plate logo Label
8
Auto-Derived Part Items
BLKLThinkSystem V3 2U x16/x8/x8 PCIe Gen4 Riser1 or 2
8
5641PX5XClarity Pro, Per Endpoint w/5 Yr SW S&S
8
1341Lenovo XClarity Pro, Per Managed Endpoint w/5 Yr SW S&S
8
3444Registration only
8
5PS7B15318Essential ThinkAgile CN - 5Yr 24x7 4Hr Resp + YDYD HX650 V3
8
7S0XCTO5WWXClarity Controller
8
SBCVLenovo XClarity XCC2 Platinum Upgrade (FOD)
8