Proxmox as CEPH Nautilus client

Alwin

Proxmox Staff Member
Staff member
Aug 1, 2017
2,816
247
63
This depends on the 'ceph osd set-require-min-compat-client' setting and defines the oldest client that can connect. Here you have to keep the kernel client in mind too, so luminous or jewel if stock debian ceph packages are used (fresh install).
 

janos

Member
Aug 24, 2017
151
14
18
Hungary
Currently we have mimic on CentOS, min client is jewel. So, theoritically ceph client in proxmox can connect to nautilus ceph, if it allow it.

thanks.
 

Alwin

Proxmox Staff Member
Staff member
Aug 1, 2017
2,816
247
63
Yes and easy to try. ;)
 

sdfungi

New Member
Jul 17, 2019
5
0
1
43
With 6.0-4 released what is the roadmap to migrate the Ceph client to a newer version?
 

mmidgett

New Member
Dec 31, 2012
19
0
1
I have 5.4 VE connected to external Nautilus cluster. Not seen any problem yet.
 

sdfungi

New Member
Jul 17, 2019
5
0
1
43
I have 5.4 VE connected to external Nautilus cluster. Not seen any problem yet.
I have no issues getting to connect to Nautilus. It appears that Proxmox is still using the Jewel client which limits the ability to use some settings.
 

sdfungi

New Member
Jul 17, 2019
5
0
1
43
https://pve.proxmox.com/wiki/Package_Repositories

This is Proxmox VE’s main Ceph repository and holds the Ceph packages for production use. You can also use this repository to update only the Ceph client.

File /etc/apt/sources.list.d/ceph.list
deb http://download.proxmox.com/debian/ceph-nautilus buster main
It would appear that 6.0-4 is still using the jewel client.

Error EPERM: cannot set require_min_compat_client to luminous: 3 connected client(s) look like jewel (missing 0x800000000000000);
 

Alwin

Proxmox Staff Member
Staff member
Aug 1, 2017
2,816
247
63
It would appear that 6.0-4 is still using the jewel client.
A fresh Proxmox VE 6 or buster installation uses the luminous client.
Code:
:~# dpkg -l | grep ceph
ii  ceph-common                          12.2.11+dfsg1-2.1           amd64        common utilities to mount and interact with a ceph storage cluster
ii  ceph-fuse                            12.2.11+dfsg1-2.1           amd64        FUSE-based client for the Ceph distributed file system
ii  libcephfs2:amd64                     12.2.11+dfsg1-2.1           amd64        Ceph distributed file system client library
ii  python-cephfs                        12.2.11+dfsg1-2.1           amd64        Python libraries for the Ceph libcephfs library
 

sdfungi

New Member
Jul 17, 2019
5
0
1
43
A fresh Proxmox VE 6 or buster installation uses the luminous client.
Code:
:~# dpkg -l | grep ceph
ii  ceph-common                          12.2.11+dfsg1-2.1           amd64        common utilities to mount and interact with a ceph storage cluster
ii  ceph-fuse                            12.2.11+dfsg1-2.1           amd64        FUSE-based client for the Ceph distributed file system
ii  libcephfs2:amd64                     12.2.11+dfsg1-2.1           amd64        Ceph distributed file system client library
ii  python-cephfs                        12.2.11+dfsg1-2.1           amd64        Python libraries for the Ceph libcephfs library
Odd I show the file versions as 14.2.1-pve2 for these files.

I installed 5.4 Fresh with no Ceph upgraded to 6.0-1 Beta install Ceph and then upgraded to 6.0-4 release
 

Alwin

Proxmox Staff Member
Staff member
Aug 1, 2017
2,816
247
63
I installed 5.4 Fresh with no Ceph upgraded to 6.0-1 Beta install Ceph and then upgraded to 6.0-4 release
Once you installed ceph explicitly, then it is 14.2.1. The packages I mentioned are from a stock install, without any extra package installation.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE and Proxmox Mail Gateway. We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!