Hi,
we caught the job to migrate 3 very bad administered proxmox 3 node clusters with ceph from an associated development department into a new central administered proxmox cluster. For evaluating a migration path first we setup a single proxmox node an tried to connect this node to the current existing ceph clusters (with older versions of ceph) and tested if an image move to our new ceph cluster works.
First of all creation of new vm images on a new ceph cluster (Luminous) works.
Than we connected rbd to the old ceph clusters. The connection process worked. We can see the content and status details of all old ceph clusters in the dashboard of our new proxmox host.
But moving or creating images on the old clusters doesn't work.
Error on create:
or
Error on move:
Cluster 1 is running Version v0.94.9 Hammer
Cluster 2 is runnung Version v0.80.11 Firefly
Cluster 3 is running Version v10.2.8 Jewel (this is the only one of our old clusters we can work with - moving an creating of images works)
Do you have any ideas if and how we can get a working connection with our old clusters?
Thx in advanced
we caught the job to migrate 3 very bad administered proxmox 3 node clusters with ceph from an associated development department into a new central administered proxmox cluster. For evaluating a migration path first we setup a single proxmox node an tried to connect this node to the current existing ceph clusters (with older versions of ceph) and tested if an image move to our new ceph cluster works.
First of all creation of new vm images on a new ceph cluster (Luminous) works.
Than we connected rbd to the old ceph clusters. The connection process worked. We can see the content and status details of all old ceph clusters in the dashboard of our new proxmox host.
But moving or creating images on the old clusters doesn't work.
Error on create:
Code:
Sep 23 15:30:54 pmx3 pvedaemon[34876]: <root@pam> starting task UPID:pmx3:0000234D:008824CB:5BA7958E:qmcreate:500:root@pam:
Sep 23 15:30:55 pmx3 pvedaemon[9037]: VM 500 creating disks failed
Sep 23 15:30:55 pmx3 pvedaemon[9037]: unable to create VM 500 - error with cfs lock 'storage-WEC-CEPH': rbd create vm-500-disk-0' error: error writing header: (38) Function not implemented
Sep 23 15:30:55 pmx3 pvedaemon[34876]: <root@pam> end task UPID:pmx3:0000234D:008824CB:5BA7958E:qmcreate:500:root@pam: unable to create VM 500 - error with cfs lock 'storage-WEC-CEPH': rbd create vm-500-disk-0' error: error writing header: (38) Function not implemented
or
Error on move:
Code:
Sep 23 15:44:52 pmx3 pvedaemon[10186]: <root@pam> move disk VM 500: move --disk virtio0 --storage WEC-CEPH
Sep 23 15:44:52 pmx3 pvedaemon[10186]: <root@pam> starting task UPID:pmx3:00003D2C:00896BD6:5BA798D4:qmmove:500:root@pam:
Sep 23 15:44:52 pmx3 pvedaemon[15660]: storage migration failed: error with cfs lock 'storage-WEC-CEPH': rbd create vm-500-disk-0' error: error writing header: (38) Function not implemented
Sep 23 15:44:52 pmx3 pvedaemon[10186]: <root@pam> end task UPID:pmx3:00003D2C:00896BD6:5BA798D4:qmmove:500:root@pam: storage migration failed: error with cfs lock 'storage-WEC-CEPH': rbd create vm-500-disk-0' error: error writing header: (38) Function not implemented
Cluster 1 is running Version v0.94.9 Hammer
Cluster 2 is runnung Version v0.80.11 Firefly
Cluster 3 is running Version v10.2.8 Jewel (this is the only one of our old clusters we can work with - moving an creating of images works)
Do you have any ideas if and how we can get a working connection with our old clusters?
Thx in advanced