[SOLVED] RBD error: rbd error: rbd: list: (2) No such file or directory

[leovinci81]

Hi,

Got quite an annoying problem
I just launched my 3 node cluster with 3 OSD for each node.
Ceph is working fine & healthy.

2nd I created my RBD storage & assigned it to the pool

rbd: Machines
monhost 192.168.140.50,192.168.140.51,192.168.140.52
content images
krbd 0
pool rbd
username admin

Then I created the keyring
cp /etc/pve/priv/ceph.client.admin.keyring /etc/pve/priv/ceph/Machines.keyring

but sadly each time when I try to create a new VM or try to migrate a disk towards the RBD pool I always receive following message:

Task viewer: VM 100 - Move disk

OutputStatus

Stop
create full clone of drive sata0 (local-lvm:vm-100-disk-1)
TASK ERROR: storage migration failed: rbd error: rbd: list: (2) No such file or directory

OR:


Task viewer: VM 101 - Create

OutputStatus

Stop
TASK ERROR: create failed - rbd error: rbd: list: (2) No such file or directory

I did several removals of the RDB, reboots of cluster, regenerated keyring multiple times

Any suggestions ..?

 

[leovinci81]

Seems that the issue was between keyboard & chair ;-))

wrong naming of OSD pool:

root@PEA-CR-SRV01:~# ceph osd lspools
1 SRV1,

by default DRB, changed to SRV1, all ok now.

 

[sarwanjassi]

If you’re not able to migrate vm b/w nodes it can be issue with local ceph.conf file located in /etc/ceph as symbolic link:

In order to fix the issue we need to rename the ceph.conf file symbolic link and it will work like charm.

Don’t Touch /etc/pve/ceph.conf as its required




After rename vm migrated


2021-12-10 22:24:48 migration status: active (transferred 420475910, remaining 5021327360), total 8607571968)
2021-12-10 22:24:48 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:49 migration status: active (transferred 970023784, remaining 4470259712), total 8607571968)
2021-12-10 22:24:49 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:50 migration status: active (transferred 1572524552, remaining 3866808320), total 8607571968)
2021-12-10 22:24:50 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:51 migration status: active (transferred 2164497346, remaining 3239002112), total 8607571968)
2021-12-10 22:24:51 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:52 migration status: active (transferred 2755754099, remaining 2599751680), total 8607571968)
2021-12-10 22:24:52 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:53 migration status: active (transferred 3342202891, remaining 2012876800), total 8607571968)
2021-12-10 22:24:53 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:54 migration status: active (transferred 3921808748, remaining 1422364672), total 8607571968)
2021-12-10 22:24:54 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:55 migration status: active (transferred 4512280675, remaining 816013312), total 8607571968)
2021-12-10 22:24:55 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:56 migration status: active (transferred 5103732827, remaining 201519104), total 8607571968)
2021-12-10 22:24:56 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:57 migration status: active (transferred 5162689485, remaining 139595776), total 8607571968)
2021-12-10 22:24:57 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:57 migration status: active (transferred 5222714605, remaining 79687680), total 8607571968)
2021-12-10 22:24:57 migration xbzrle cachesize: 1073741824 transferred 0 pages 0 cachemiss 0 overflow 0
2021-12-10 22:24:57 migration speed: 819.20 MB/s - downtime 67 ms
2021-12-10 22:24:57 migration status: completed
2021-12-10 22:25:00 migration finished successfully (duration 00:00:15)
TASK OK

Please note down for any future migration issue.