question about Disk sdX to SATA

vikozo

Renowned Member
May 4, 2014
781
31
93
suisse
www.wombat.ch
Hello

i have Proxmox 4 difertent Disk each with 6TB formet to a Raidz2!
how do i find out which sda,b,c,d belongs to which SATA connection?

how are you doing it - writing down on a Excel the Serial Number and how connected?

have a nice day
vinc
 
Not at all. Why do you need to know that? Technically the mapping of physical disk to sdX could change as well.
If you need to know which disk is having bad SMART values or something like this you can use smartctl -i /dev/sdX to get the serial number for that disk which then allows you to find the physical disk.

If it is not the root pool you can reimport the pool and point the zpool command to the /dev/disk/by-id directory to search for pools. This way it will use the unique IDs of the disk instead of the vague /dev/sdX paths.

For example:
Code:
zpool export <mypool>
zpool import -d /dev/disk/by-id <mypool>
 
Besides Aaron's good suggestion to map serial number from smartctl output with the label on disks you could also try ledctl from the ledmon package:

Code:
ledctl locate=/dev/sda
# see which one blinks, once done turn locate off again
ledctl locate_off=/dev/sda

It might not work on every setup but maybe worth a try, especially if the disk labels are not really accessible to look at.
 
@t.lamprecht @aaron thanks for your feedback
aaron you are right the point is i have 6 Disk, a disk goes bad, which one do i have to remove/replace?
so i will need a excel with the serial Number and the SATA port or the descritption where the disk is on the chassis

have a nice day
vinc
 
Okay, the way I handle such a situation is different. Mainly because in my experience a list that is somewhere else will be out of date very soon and not reflect reality anymore.

If the indicator LED on the drive cage works, great. Additionally, I try to note down the disks serial number close to the actual disk. For disks in individual caddies, this means that I will use a label printer to print the disks serial number and stick the label on the drive caddy.

This is a bit of work at first and replacing a disk also means to print a new label but it adds another level of making sure to pull the right disk. The serial number can be easily obtained as I described earlier. When using /dev/disk/by-id it is even part of the ID and you will see the disks serial number in the output of zpool status.
 
@t.lamprecht Merci
to install ledmon did not help maybe because of the
IcyDock - FatCage MB153SP-B i have
as soon i do the command all led flash

@aaron
thanks for your feedback too, i have writen on my cage just sata0 to sata6 to know where it is - but not enough
i will have to label it like you wrote it.
just thinking how do this people which have a lots of disk to manage?

or a sugestion for Proxmox
on the Node where the Disk are, a fild "Bemerkung" to write in - which SATA place it is and would merge to the Serial Number!

another question - i take out a disk - to check whats happen.
when i put the disk back it will not join automaticly the zpool?

have a nice day
vinc
 
as soon i do the command all led flash

Hmm, to bad - would have been nice - I'm a bit wondering though, the cage is connected via three SATA ports, so it should be distinguishable, but well seems not to be the case.

just thinking how do this people which have a lots of disk to manage?

A lot use some sort of inventory system, especially if there is a higher count of other servers and even other HW (Desktops in offices, switches, ...) involved.

That really can start out as a excel sheet, or a internal wiki. Some monitoring applications also have a inventory feature (e.g., Zabbix has one, not the most straight forward but once one is into it it's OK, IMO) there are also independent server/hardware inventory systems, may be worth it only once one has to much HW to sanely keep an overview with simpler methods.

on the Node where the Disk are, a fild "Bemerkung" to write in - which SATA place it is and would merge to the Serial Number!

In general I agree with you here, they main reason that does not yet exists is rather a technical one, i.e., we do not save state of any disks - we always just scan what's there. So we would need to add some disk-to-notes mapping somewhere. A single metadata file per cluster with a disks with the ID or the UUID as index and then some metadata like a comment could work here.

when i put the disk back it will not join automaticly the zpool?

If the server was offline during this then it should join just fine (somewhat obviously as ZFS did not noticed that it was away), else you may not yet installed the zfs-zed package which handles those events automatically, it should get pulled in on update since PVE 6.1 though.

Additionally, you can always try to bring up a device online manually by doing:
Code:
zpool online /dev/...
 
Hello @t.lamprecht

i have installed
apt-get install zfs-zed

removed a disk and as expected on the

node Disks
the disk is away (would be nice just to inform and not remove the information)

node disks zfs
it say also unavail

after adding the disk back
node Disks
show the disk is back

but on the zfs side still unavail

you wrote it should go automatic with zfs-zed, but nowhere i found a iformation is happen something to bring it back

have a nice day
vinc
 
Last edited:
Yes, a bit older versions, you should have at least the following one:

Code:
proxmox-ve: 6.1-2 (running kernel: 5.3.13-1-pve)
pve-manager: 6.1-5 (running version: 6.1-5/9bf06119)
pve-kernel-5.3: 6.1-1
pve-kernel-helper: 6.1-1
pve-kernel-5.3.13-1-pve: 5.3.13-1
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.0.2-pve4
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: 0.8.35+pve1
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.13-pve1
libpve-access-control: 6.0-5
libpve-apiclient-perl: 3.0-2
libpve-common-perl: 6.0-10
libpve-guest-common-perl: 3.0-3
libpve-http-server-perl: 3.0-3
libpve-storage-perl: 6.1-3
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve3
lxc-pve: 3.2.1-1
lxcfs: 3.0.3-pve60
novnc-pve: 1.1.0-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.1-2
pve-cluster: 6.1-3
pve-container: 3.0-16
pve-docs: 6.1-3
pve-edk2-firmware: 2.20191127-1
pve-firewall: 4.0-9
pve-firmware: 3.0-4
pve-ha-manager: 3.0-8
pve-i18n: 2.0-3
pve-qemu-kvm: 4.1.1-2
pve-xtermjs: 3.13.2-1
qemu-server: 6.1-4
smartmontools: 7.1-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
zfsutils-linux: 0.8.2-pve2

Please check if you have a valid repository setup: https://pve.proxmox.com/wiki/Package_Repositories
I.e., if you do not have a subscription for this, then ensure the "pve-no-subscription" is setup, and then update (over webinterface or console).
 
installation is 3 Days old

The latest ISO is from start of December, almost two month old now - so there are some updates available.

also the gui says no update
That's probably because no valid PVE repo is configured, see previous post.
 
Where's then the proxmox entry:
Code:
deb http://download.proxmox.com/debian/pve buster pve-no-subscription

? ;)
there i have been sure it is there, sorry
--------------------
after update
and as told the reboot

it stops at error checksum verification failed
Entering rescue mode....
grub rescue>
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!