Connect and workink with older ceph clusters fails

ewuewu

Renowned Member
Sep 14, 2010
58
0
71
Hamburg
Hi,

we caught the job to migrate 3 very bad administered proxmox 3 node clusters with ceph from an associated development department into a new central administered proxmox cluster. For evaluating a migration path first we setup a single proxmox node an tried to connect this node to the current existing ceph clusters (with older versions of ceph) and tested if an image move to our new ceph cluster works.

First of all creation of new vm images on a new ceph cluster (Luminous) works.

Than we connected rbd to the old ceph clusters. The connection process worked. We can see the content and status details of all old ceph clusters in the dashboard of our new proxmox host.
But moving or creating images on the old clusters doesn't work.

Error on create:
Code:
Sep 23 15:30:54 pmx3 pvedaemon[34876]: <root@pam> starting task UPID:pmx3:0000234D:008824CB:5BA7958E:qmcreate:500:root@pam:
Sep 23 15:30:55 pmx3 pvedaemon[9037]: VM 500 creating disks failed
Sep 23 15:30:55 pmx3 pvedaemon[9037]: unable to create VM 500 - error with cfs lock 'storage-WEC-CEPH': rbd create vm-500-disk-0' error: error writing header: (38) Function not implemented
Sep 23 15:30:55 pmx3 pvedaemon[34876]: <root@pam> end task UPID:pmx3:0000234D:008824CB:5BA7958E:qmcreate:500:root@pam: unable to create VM 500 - error with cfs lock 'storage-WEC-CEPH': rbd create vm-500-disk-0' error: error writing header: (38) Function not implemented

or

Error on move:
Code:
Sep 23 15:44:52 pmx3 pvedaemon[10186]: <root@pam> move disk VM 500: move --disk virtio0 --storage WEC-CEPH
Sep 23 15:44:52 pmx3 pvedaemon[10186]: <root@pam> starting task UPID:pmx3:00003D2C:00896BD6:5BA798D4:qmmove:500:root@pam:
Sep 23 15:44:52 pmx3 pvedaemon[15660]: storage migration failed: error with cfs lock 'storage-WEC-CEPH': rbd create vm-500-disk-0' error: error writing header: (38) Function not implemented
Sep 23 15:44:52 pmx3 pvedaemon[10186]: <root@pam> end task UPID:pmx3:00003D2C:00896BD6:5BA798D4:qmmove:500:root@pam: storage migration failed: error with cfs lock 'storage-WEC-CEPH': rbd create vm-500-disk-0' error: error writing header: (38) Function not implemented

Cluster 1 is running Version v0.94.9 Hammer
Cluster 2 is runnung Version v0.80.11 Firefly
Cluster 3 is running Version v10.2.8 Jewel (this is the only one of our old clusters we can work with - moving an creating of images works)

Do you have any ideas if and how we can get a working connection with our old clusters?

Thx in advanced
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!