Ceph 19.2 Squid Available as Technology Preview and Ceph 17.2 Quincy soon to be EOL

[t.lamprecht]

Hi Community!

The recently released Ceph 19.2 Squid is now available on the Proxmox Ceph test and no-subscription repositories to install or upgrade.

Upgrades from Reef to Squid:
You can find the upgrade how-to here: https://pve.proxmox.com/wiki/Ceph_Reef_to_Squid

New Installation of Reef:
Use the updated ceph installation wizard available with the recently released pve-manager version 8.2.8 (available on the pvetest repository at time of writing).

Current State:
We ran and tested the release since a few weeks internally and found no major issue.
Ceph 18.2 Reef will stay supported until mid-2025 for the time being.

Road to Enterprise Stability:
Our further plan is to lift the preview state and provided Squid as fully supported Ceph release once we got even more test time and feedback from QA, and naturally we would be happy to hear about the observations from our great community! Once we deem the Ceph 19.2 Squid release, and it's integration into Proxmox VE fully production ready, we'll also populate the Ceph Squid enterprise repository.

Reminder: Old Ceph 17.2 Quincy Going EOL Soon:
Please also remember that Ceph 17.2 Pacific is going to be end of life (EOL) soon and received no update since a while already. So you should upgrade any existing Ceph Quincy setups to Ceph Reef, or soon also Ceph Squid, rather sooner than later. See the upgrade how-to: https://pve.proxmox.com/wiki/Ceph_Quincy_to_Reef.

We welcome your feedback!

 

[ness1602]

I've upgraded one 4-node cluster,no problems for now.

 

[Nemesiz]

Squid have problems with orchestrator and dashboard functionality. As one created issue https://tracker.ceph.com/issues/68657
In my test lab I had the same thing. I`m just saying for just in case.

 

[t.lamprecht]

Squid have problems with orchestrator and dashboard functionality. As one created issue https://tracker.ceph.com/issues/68657
In my test lab I had the same thing. I`m just saying for just in case.

For completeness' sake: Proxmox VE's Ceph management stack does not depend on any of those two, but some might use them nonetheless, so thanks for posting that hint as heads up for those users.

 

[itNGO]

Just to be sure... the pure upgrade would not enable any "Crimson" feature for now? It's just the latest version and for anything else manual configuration will be necessary?

 

[t.lamprecht]

Just to be sure... the pure upgrade would not enable any "Crimson" feature for now? It's just the latest version and for anything else manual configuration will be necessary?

No, Crimosn is a technology preview in the Ceph 19.2 Squid release and is currently not enabled on build in our packaging.
We will take a closer look at how to expose it as opt-in co-installable with ceph-osd in the future, at the moment we're more interested in ensuring Ceph 19.2 Squid gets as stable as is.

 

[yangsm]

I hope to build a separate version of Crimosn to test its performance.

 

[jsterr]

We updated one of our clusters already, no issues so far (no downtime, everything correct).

 

[Neobin]

This is an up-to-date (no subscription) PVE installation with PBS alongside, but without a Ceph full-installation; only the default ootb parts:

Spoiler: apt list --upgradable

Listing... Done
ceph-common/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
ceph-fuse/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
libcephfs2/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
librados2/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
libradosstriper1/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
librbd1/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
librgw2/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
python3-ceph-argparse/stable 19.2.0-pve1 all [upgradable from: 18.2.4-pve3]
python3-ceph-common/stable 19.2.0-pve1 all [upgradable from: 18.2.4-pve3]
python3-cephfs/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
python3-rados/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
python3-rbd/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
python3-rgw/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]

Spoiler: apt full-upgrade

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following NEW packages will be installed:
  autoconf automake autotools-dev cpp cpp-12 gcc gcc-12 libabsl20220623 libaom3 libasan8 libatomic1 libavif15 libc-dev-bin libc-devtools libc6-dev libcc1-0 libcrypt-dev libdav1d6 libde265-0 libdeflate0 libgav1-1 libgcc-12-dev libgd3
  libgomp1 libheif1 libisl23 libitm1 libjbig0 liblerc4 liblsan0 libltdl-dev liblua5.3-dev libmpc3 libmpfr6 libncurses-dev libnsl-dev libpkgconf3 libquadmath0 librav1e0 libreadline-dev libsvtav1enc1 libtiff6 libtirpc-dev libtool
  libtool-bin libtsan2 libubsan1 libwebp7 libx265-199 libxpm4 libyuv0 linux-libc-dev lua-any lua-sec lua-socket lua5.1 luarocks m4 manpages-dev pkg-config pkgconf pkgconf-bin rpcsvc-proto unzip zip
The following packages will be upgraded:
  ceph-common ceph-fuse libcephfs2 librados2 libradosstriper1 librbd1 librgw2 python3-ceph-argparse python3-ceph-common python3-cephfs python3-rados python3-rbd python3-rgw
13 upgraded, 65 newly installed, 0 to remove and 0 not upgraded.
Need to get 106 MB of archives.
After this operation, 254 MB of additional disk space will be used.

Is it expected, that there will get 65 new packages get pulled in?

 

[fiona]

Hi,

This is an up-to-date (no subscription) PVE installation with PBS alongside, but without a Ceph full-installation; only the default ootb parts:

Spoiler: apt list --upgradable

Listing... Done
ceph-common/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
ceph-fuse/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
libcephfs2/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
librados2/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
libradosstriper1/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
librbd1/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
librgw2/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
python3-ceph-argparse/stable 19.2.0-pve1 all [upgradable from: 18.2.4-pve3]
python3-ceph-common/stable 19.2.0-pve1 all [upgradable from: 18.2.4-pve3]
python3-cephfs/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
python3-rados/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
python3-rbd/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]
python3-rgw/stable 19.2.0-pve1 amd64 [upgradable from: 18.2.4-pve3]

Spoiler: apt full-upgrade

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following NEW packages will be installed:
  autoconf automake autotools-dev cpp cpp-12 gcc gcc-12 libabsl20220623 libaom3 libasan8 libatomic1 libavif15 libc-dev-bin libc-devtools libc6-dev libcc1-0 libcrypt-dev libdav1d6 libde265-0 libdeflate0 libgav1-1 libgcc-12-dev libgd3
  libgomp1 libheif1 libisl23 libitm1 libjbig0 liblerc4 liblsan0 libltdl-dev liblua5.3-dev libmpc3 libmpfr6 libncurses-dev libnsl-dev libpkgconf3 libquadmath0 librav1e0 libreadline-dev libsvtav1enc1 libtiff6 libtirpc-dev libtool
  libtool-bin libtsan2 libubsan1 libwebp7 libx265-199 libxpm4 libyuv0 linux-libc-dev lua-any lua-sec lua-socket lua5.1 luarocks m4 manpages-dev pkg-config pkgconf pkgconf-bin rpcsvc-proto unzip zip
The following packages will be upgraded:
  ceph-common ceph-fuse libcephfs2 librados2 libradosstriper1 librbd1 librgw2 python3-ceph-argparse python3-ceph-common python3-cephfs python3-rados python3-rbd python3-rgw
13 upgraded, 65 newly installed, 0 to remove and 0 not upgraded.
Need to get 106 MB of archives.
After this operation, 254 MB of additional disk space will be used.

Is it expected, that there will get 65 new packages get pulled in?

thanks for the report! What if you use --no-install-recommends?

From a quick glance, it seems like the "culprit" is librgw2 -Depends-> liblua5.3-dev -Recommends-> libtool-bin

root@pve8a1 ~ # aptitude why autoconf
i   ceph-common   Depends    python3-rgw (= 19.2.0-pve1)
i A python3-rgw   Depends    librgw2 (>= 19.2.0-pve1)  
i A librgw2       Depends    liblua5.3-dev              
i A liblua5.3-dev Recommends libtool-bin                
i A libtool-bin   Depends    libtool (>= 2.4.7-7~deb12u1)
i A libtool       Recommends libltdl-dev                
i A libltdl-dev   Depends    automake-1.16              
i A automake      Provides   automake-1.16              
i A automake      Depends    autoconf