[solved] Timed out waiting for device /dev/disk/by-uuid/...

[Didier Misson]

Hello.
Just upgrade to Proxmox 6.2.4, and reboot the server.
I see strange messages in the syslog :

May 14 00:03:30 rbx06 systemd[1]: dev-disk-by\x2duuid-62ccfba0\x2d6394\x2d42c0\x2dbd38\x2d3da2ea4893b6.device: Job dev-disk-by\x2duuid-62ccfba0\x2d6394\x2d42c0\x2dbd38\x2d3da2ea4893b6.device/start timed out.
May 14 00:03:30 rbx06 systemd[1]: Timed out waiting for device /dev/disk/by-uuid/62ccfba0-6394-42c0-bd38-3da2ea4893b6.
May 14 00:03:30 rbx06 systemd[1]: Dependency failed for /dev/disk/by-uuid/62ccfba0-6394-42c0-bd38-3da2ea4893b6.
May 14 00:03:30 rbx06 systemd[1]: dev-disk-by\x2duuid-62ccfba0\x2d6394\x2d42c0\x2dbd38\x2d3da2ea4893b6.swap: Job dev-disk-by\x2duuid-62ccfba0\x2d6394\x2d42c0\x2dbd38\x2d3da2ea4893b6.swap/start failed with result 'dependency'.
May 14 00:03:30 rbx06 systemd[1]: dev-disk-by\x2duuid-62ccfba0\x2d6394\x2d42c0\x2dbd38\x2d3da2ea4893b6.device: Job dev-disk-by\x2duuid-62ccfba0\x2d6394\x2d42c0\x2dbd38\x2d3da2ea4893b6.device/start failed with result 'timeout'.
May 14 00:04:00 rbx06 systemd[1]: Starting Proxmox VE replication runner...
May 14 00:04:00 rbx06 systemd[1]: pvesr.service: Succeeded.
May 14 00:04:00 rbx06 systemd[1]: Started Proxmox VE replication runner.

Never see this before.
I try to look the uuid with blkid : I don't see this uuid !
Thanks.
Didier

 

[Didier Misson]

oh, I find the UUID !
in /etc/fstab :

UUID="00ccf5d4-b055-49c6-81e8-a689d4944d21" / ext4 defaults 0 0
UUID="ba08dcf1-edf2-4c22-98f8-b1f3ec4ef530" /var/lib/vz ext4 defaults 0 0

UUID="62ccfba0-6394-42c0-bd38-3da2ea4893b6" swap swap defaults 0 0

UUID="be06050e-8527-4dc6-9ccb-34fe72bf211a" swap swap defaults 0 0
LABEL=EFI_SYSPART /boot/efi vfat defaults 0 0


Why ?
I don't change the swap... oh ... perhaps YES ?

It's a RAID on 2 Intel SSD.
2 months ago, one SSD failed and OVH replace it.
And I rebuild the software RAID...

So, if SSD was replaced... UUID has change ?

 

[Didier Misson]

ok, these message on disk is simply due to a SSD replacement in a RAID.
I rebuild the soft RAID... but I forgot to create the new swap on /dev/sda3 :

# swapon -show
Filename Type Size Used Priority
/dev/sdb3 partition 1047548 254976 -2

Swap on sdb3, but NOT on sda3

But /etc/fstab always has the swap definition with the UUID of the previous SSD...


I create the swap partition on sda3 :

mkswap /dev/sda3
Setting up swapspace version 1, size = 1023 MiB (1072689152 bytes)
no label, UUID=3ce8f0ff-b37d-4470-a6b5-1e5f3f3e3049

I change the FSTAB 1st swap line :

UUID="3ce8f0ff-b37d-4470-a6b5-1e5f3f3e3049" swap swap defaults 0 0

And active it :

# swapon -a
# swapon -show
Filename Type Size Used Priority
/dev/sdb3 partition 1047548 254720 -2
/dev/sda3 partition 1047548 0 -3

ok. Not sure old swap from the previous SSD is remove...
But I will see it in the long in 2 minutes...

Unfortunately, error messages are yet in the syslog.

I reboot the server, and now the disk error message gone away.

 

[aaron]

Good to hear that you were able to solve this yourself . Would you please be so kind to add the "solved" prefix by editing the first post? Should be next to the title field. Thanks

 

[Didier Misson]

yes of course.
it was NOT a Proxmox problem

 

[tty8747]

Hello, I have the same problem, but I can't find the problem uuid in my /etc/fstab.
Log:

Sep  1 18:25:01 iron systemd[1]: dev-disk-by\x2duuid-ceb9d913\x2da8ef\x2d4388\x2dadfd\x2dde8552690cb2.device: Job dev-disk-by\x2duuid-ceb9d913\x2da8ef\x2d4388\x2dadfd\x2dde8552690cb2.device/start timed out.

Sep  1 18:25:01 iron systemd[1]: Timed out waiting for device /dev/disk/by-uuid/ceb9d913-a8ef-4388-adfd-de8552690cb2.
Sep  1 18:25:01 iron systemd[1]: dev-disk-by\x2duuid-ceb9d913\x2da8ef\x2d4388\x2dadfd\x2dde8552690cb2.device: Job dev-disk-by\x2duuid-ceb9d913\x2da8ef\x2d4388\x2dadfd\x2dde8552690cb2.device/start failed with result 'timeout'.

There isn't "ceb9d913" in fstab:

$ cat /etc/fstab | grep -i ceb9d913

$ cat /etc/fstab
# /etc/fstab: static file system information.
#
# Use 'blkid' to print the universally unique identifier for a
# device; this may be used with UUID= as a more robust way to name devices
# that works even if disks are added and removed. See fstab(5).
#
# <file system> <mount point>   <type>  <options>       <dump>  <pass>
/dev/mapper/iron--vg-root /               ext4    errors=remount-ro 0       1

# /boot was on /dev/sdc1 during installation
UUID=fbaf100c-b16b-4a38-8006-fd2cb83fc796 /boot           ext2    defaults        0       2
/dev/mapper/iron--vg-swap_1 none            swap    sw,pri=5              0       0
/dev/zram0 none swap defaults,pri=10 0 0
UUID=a0f1f105-8aa1-46df-8ce3-5ed5f61c15a2 /mnt/pve/ssdraid/ ext4 defaults,nofail,discard 0 0
UUID=b79af75b-af7e-4947-a3be-ec63a123a006 /mnt/pve/single_backup ext4 defaults,noatime,nofail 0 0

UUID's in my system:

$ ls /dev/disk/by-uuid/ | grep ceb9d913
$ ls /dev/disk/by-uuid/
57d7ca12-8259-49a9-9150-6a36844c610d  b79af75b-af7e-4947-a3be-ec63a123a006
60f0427d-67d8-44f5-9cae-614cfda82ae6  d454e542-74d7-4f7d-baa3-09087c9f45d1
9b69c813-e76b-4fbb-9b7c-c1216b86d868  dd7be75b-45b0-4adc-a831-b07ce2527c28
a0f1f105-8aa1-46df-8ce3-5ed5f61c15a2  fbaf100c-b16b-4a38-8006-fd2cb83fc796

Can anybody help me?

 

[tty8747]

I decided to find it in /etc and I've found it!

$ sudo grep -iR ceb9d913 /etc/
/etc/systemd/system/multi-user.target.wants/mnt-pve-raid.mount:What=/dev/disk/by-uuid/ceb9d913-a8ef-4388-adfd-de8552690cb2
/etc/systemd/system/mnt-pve-raid.mount:What=/dev/disk/by-uuid/ceb9d913-a8ef-4388-adfd-de8552690cb2

$ sudo systemctl is-enabled mnt-pve-raid.mount
enabled
$ sudo systemctl cat mnt-pve-raid.mount
# /etc/systemd/system/mnt-pve-raid.mount
[Install]
WantedBy=multi-user.target

[Mount]
Options=defaults
Type=ext4
What=/dev/disk/by-uuid/ceb9d913-a8ef-4388-adfd-de8552690cb2
Where=/mnt/pve/raid

[Unit]
Description=Mount storage 'raid' under /mnt/pve

Also I've found it here:

How I can kick the uuid out?
I suppose I might use $ sudo systemctl disable mnt-pve-raid.mount, but what is the right way?

 

[mircea.renea]

I decided to find it in /etc and I've found it!

$ sudo grep -iR ceb9d913 /etc/
/etc/systemd/system/multi-user.target.wants/mnt-pve-raid.mount:What=/dev/disk/by-uuid/ceb9d913-a8ef-4388-adfd-de8552690cb2
/etc/systemd/system/mnt-pve-raid.mount:What=/dev/disk/by-uuid/ceb9d913-a8ef-4388-adfd-de8552690cb2

$ sudo systemctl is-enabled mnt-pve-raid.mount
enabled
$ sudo systemctl cat mnt-pve-raid.mount
# /etc/systemd/system/mnt-pve-raid.mount
[Install]
WantedBy=multi-user.target

[Mount]
Options=defaults
Type=ext4
What=/dev/disk/by-uuid/ceb9d913-a8ef-4388-adfd-de8552690cb2
Where=/mnt/pve/raid

[Unit]
Description=Mount storage 'raid' under /mnt/pve

Also I've found it here:
View attachment 40622
How I can kick the uuid out?
I suppose I might use $ sudo systemctl disable mnt-pve-raid.mount, but what is the right way?

More--->Distroy