ZFS problem with LSI Broadcom SAS 9300-8i

j4ys0n

Member
Jan 15, 2020
38
7
13
Hello!

I'm having some issues with my new ZFS pool that I can't quite figure out.

I have a LSI Broadcom SAS 9300-8i with 4x 5TB 2.5" SATA drives hooked up to each SAS port, for a total of 8x 5TB drives. For cache, I have 4x 1TB SSDs plugged into the motherboard.

pool: tatooine
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
tatooine ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
wwn-0x5000c500c2990593 ONLINE 0 0 0
wwn-0x5000c500b6b1f5ab ONLINE 0 0 0
wwn-0x5000c500b6ce68cc ONLINE 0 0 0
wwn-0x5000c500b6ca6db0 ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
wwn-0x5000c500b6cdb773 ONLINE 0 0 0
wwn-0x5000c500b6ca3ee1 ONLINE 0 0 0
wwn-0x5000c500c2b9354e ONLINE 0 0 0
wwn-0x5000c500c2b2b82f ONLINE 0 0 0
logs
mirror-2 ONLINE 0 0 0
wwn-0x5002538e0989b922-part2 ONLINE 0 0 0
wwn-0x5002538e0989b933-part2 ONLINE 0 0 0
mirror-3 ONLINE 0 0 0
wwn-0x5002538e0989b923-part2 ONLINE 0 0 0
wwn-0x5002538e9982410f-part2 ONLINE 0 0 0
cache
wwn-0x5002538e0989b922-part1 ONLINE 0 0 0
wwn-0x5002538e0989b933-part1 ONLINE 0 0 0
wwn-0x5002538e0989b923-part1 ONLINE 0 0 0
wwn-0x5002538e9982410f-part1 ONLINE 0 0 0

errors: No known data errors


Any time I try to use the volume, the 5TB disks attached to the HBA start dropping out. Could the HBA be bad? Maybe there's something I need to install, or a setting somewhere I'm unaware of, or the firmware needs to be upgraded?
 
  • Like
Reactions: velocity08
Could be the HBA, could also be drive firmware incompatibility.
Had similar issues with very old firmware versions of my 9211-8i cards (don't remember which version it was) in combination with Linux MDADM (Software RAID) but once upgraded to a decent version it was running fine (up until now).
Have you checked if there are new FW versions available for Disks and / or the HBA?
Also could be bad (cheap) cables.
 
  • Like
Reactions: velocity08

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!