Ceph Quincy/Reef installation from scratch

Output of pveceph install :
Code: 
root@pve1:~# pveceph install

WARN: Enterprise repository selected, but no active subscription!

This will install Ceph Quincy - continue (y/N)? n
Aborting installation as requested
root@pve1:~#

I declined the installation and tried "pveceph install --repository no-subscription" :

Code: 
root@pve1:~# pveceph install --repository no-subscription

HINT: The no-subscription repository is not the best choice for production setups.
Proxmox recommends using the enterprise repository with a valid subscription.
This will install Ceph Quincy - continue (y/N)? y
update available package list
start installation
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
ceph-common is already the newest version (18.2.0-pve2).
ceph-fuse is already the newest version (18.2.0-pve2).
gdisk is already the newest version (1.0.9-2.1).
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 ceph-base : Depends: ceph-common (= 17.2.7-pve1) but 18.2.0-pve2 is to be installed
 ceph-mgr : Depends: libsqlite3-mod-ceph (= 17.2.7-pve1) but it is not going to be installed
            Depends: librados2 (= 17.2.7-pve1) but 18.2.0-pve2 is to be installed
E: Unable to correct problems, you have held broken packages.
apt failed during ceph installation (25600)
root@pve1:~#

Still a bit tricky
 
Then first try "apt update && upgrade -y" (as you suggested) and see if that at least solves the current situation.
 
Code: 
root@pve1:~# apt update -y
Hit:1 http://ftp.debian.org/debian bookworm InRelease
Hit:2 http://ftp.debian.org/debian bookworm-updates InRelease
Hit:3 http://download.proxmox.com/debian/pve bookworm InRelease
Hit:4 http://security.debian.org/debian-security bookworm-security InRelease
Hit:5 http://download.proxmox.com/debian/ceph-quincy bookworm InRelease
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
23 packages can be upgraded. Run 'apt list --upgradable' to see them.
root@pve1:~#


Code: 
root@pve1:~# apt upgrade -y
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following NEW packages will be installed:
  fonts-font-logos libpve-notify-perl
The following packages will be upgraded:
  libnvpair3linux libproxmox-acme-perl libproxmox-acme-plugins libpve-access-control libpve-cluster-api-perl libpve-cluster-perl libpve-rs-perl libpve-storage-perl libuutil3linux libzfs4linux
  libzpool5linux proxmox-kernel-helper proxmox-mail-forward proxmox-widget-toolkit pve-cluster pve-firmware pve-ha-manager pve-manager pve-qemu-kvm spl zfs-initramfs zfs-zed zfsutils-linux
23 upgraded, 2 newly installed, 0 to remove and 0 not upgraded.
Need to get 117 MB of archives.
After this operation, 11.1 MB disk space will be freed.
Get:1 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 fonts-font-logos all 1.0.1-3 [112 kB]
Get:2 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libnvpair3linux amd64 2.2.0-pve3 [48.4 kB]
Get:3 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libproxmox-acme-plugins all 1.5.0 [130 kB]
Get:4 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libproxmox-acme-perl all 1.5.0 [11.0 kB]
Get:5 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-cluster-api-perl all 8.0.5 [40.0 kB]
Get:6 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-cluster-perl all 8.0.5 [23.3 kB]
Get:7 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-cluster amd64 8.0.5 [111 kB]
Get:8 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-rs-perl amd64 0.8.7 [2,354 kB]
Get:9 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-access-control all 8.0.6 [70.2 kB]
Get:10 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-notify-perl all 8.0.5 [6,304 B]
Get:11 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-storage-perl all 8.0.4 [129 kB]
Get:12 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libuutil3linux amd64 2.2.0-pve3 [39.5 kB]
Get:13 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libzfs4linux amd64 2.2.0-pve3 [212 kB]
Get:14 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libzpool5linux amd64 2.2.0-pve3 [1,306 kB]
Get:15 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-kernel-helper all 8.0.5 [15.4 kB]
Get:16 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-mail-forward amd64 0.2.1 [1,668 kB]
Get:17 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-widget-toolkit all 4.1.1 [210 kB]
Get:18 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-firmware all 3.9-1 [80.7 MB]
Get:19 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-ha-manager amd64 4.0.3 [63.4 kB]
Get:20 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-manager amd64 8.0.9 [513 kB]
Get:21 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-qemu-kvm amd64 8.1.2-2 [28.3 MB]
Get:22 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 spl all 2.2.0-pve3 [15.1 kB]
Get:23 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 zfs-initramfs all 2.2.0-pve3 [25.3 kB]
Get:24 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 zfsutils-linux amd64 2.2.0-pve3 [539 kB]
Get:25 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 zfs-zed amd64 2.2.0-pve3 [66.7 kB]
Fetched 117 MB in 10s (11.6 MB/s)
apt-listchanges: Reading changelogs...
Selecting previously unselected package fonts-font-logos.
(Reading database ... 105419 files and directories currently installed.)
Preparing to unpack .../00-fonts-font-logos_1.0.1-3_all.deb ...
Unpacking fonts-font-logos (1.0.1-3) ...
Preparing to unpack .../01-libnvpair3linux_2.2.0-pve3_amd64.deb ...
Unpacking libnvpair3linux (2.2.0-pve3) over (2.1.13-pve1) ...
Preparing to unpack .../02-libproxmox-acme-plugins_1.5.0_all.deb ...
Unpacking libproxmox-acme-plugins (1.5.0) over (1.4.6) ...
Preparing to unpack .../03-libproxmox-acme-perl_1.5.0_all.deb ...
Unpacking libproxmox-acme-perl (1.5.0) over (1.4.6) ...
Preparing to unpack .../04-libpve-cluster-api-perl_8.0.5_all.deb ...
Unpacking libpve-cluster-api-perl (8.0.5) over (8.0.4) ...
Preparing to unpack .../05-libpve-cluster-perl_8.0.5_all.deb ...
Unpacking libpve-cluster-perl (8.0.5) over (8.0.4) ...
Preparing to unpack .../06-pve-cluster_8.0.5_amd64.deb ...
Unpacking pve-cluster (8.0.5) over (8.0.4) ...
Preparing to unpack .../07-libpve-rs-perl_0.8.7_amd64.deb ...
Unpacking libpve-rs-perl (0.8.7) over (0.8.6) ...
Preparing to unpack .../08-libpve-access-control_8.0.6_all.deb ...
Unpacking libpve-access-control (8.0.6) over (8.0.5) ...
Selecting previously unselected package libpve-notify-perl.
Preparing to unpack .../09-libpve-notify-perl_8.0.5_all.deb ...
Unpacking libpve-notify-perl (8.0.5) ...
Preparing to unpack .../10-libpve-storage-perl_8.0.4_all.deb ...
Unpacking libpve-storage-perl (8.0.4) over (8.0.3) ...
Preparing to unpack .../11-libuutil3linux_2.2.0-pve3_amd64.deb ...
Unpacking libuutil3linux (2.2.0-pve3) over (2.1.13-pve1) ...
Preparing to unpack .../12-libzfs4linux_2.2.0-pve3_amd64.deb ...
Unpacking libzfs4linux (2.2.0-pve3) over (2.1.13-pve1) ...
Preparing to unpack .../13-libzpool5linux_2.2.0-pve3_amd64.deb ...
Unpacking libzpool5linux (2.2.0-pve3) over (2.1.13-pve1) ...
Preparing to unpack .../14-proxmox-kernel-helper_8.0.5_all.deb ...
Unpacking proxmox-kernel-helper (8.0.5) over (8.0.3) ...
Preparing to unpack .../15-proxmox-mail-forward_0.2.1_amd64.deb ...
Unpacking proxmox-mail-forward (0.2.1) over (0.2.0) ...
Preparing to unpack .../16-proxmox-widget-toolkit_4.1.1_all.deb ...
Unpacking proxmox-widget-toolkit (4.1.1) over (4.0.9) ...
Preparing to unpack .../17-pve-firmware_3.9-1_all.deb ...
Unpacking pve-firmware (3.9-1) over (3.8-3) ...
Preparing to unpack .../18-pve-ha-manager_4.0.3_amd64.deb ...
Unpacking pve-ha-manager (4.0.3) over (4.0.2) ...
Preparing to unpack .../19-pve-manager_8.0.9_amd64.deb ...
Unpacking pve-manager (8.0.9) over (8.0.4) ...
Preparing to unpack .../20-pve-qemu-kvm_8.1.2-2_amd64.deb ...
Unpacking pve-qemu-kvm (8.1.2-2) over (8.1.2-1) ...
Preparing to unpack .../21-spl_2.2.0-pve3_all.deb ...
Unpacking spl (2.2.0-pve3) over (2.1.13-pve1) ...
Preparing to unpack .../22-zfs-initramfs_2.2.0-pve3_all.deb ...
Unpacking zfs-initramfs (2.2.0-pve3) over (2.1.13-pve1) ...
Preparing to unpack .../23-zfsutils-linux_2.2.0-pve3_amd64.deb ...
Unpacking zfsutils-linux (2.2.0-pve3) over (2.1.13-pve1) ...
Preparing to unpack .../24-zfs-zed_2.2.0-pve3_amd64.deb ...
Unpacking zfs-zed (2.2.0-pve3) over (2.1.13-pve1) ...
Setting up libnvpair3linux (2.2.0-pve3) ...
Setting up proxmox-widget-toolkit (4.1.1) ...
Setting up pve-qemu-kvm (8.1.2-2) ...
Setting up pve-firmware (3.9-1) ...
Setting up proxmox-mail-forward (0.2.1) ...
Setting up libproxmox-acme-perl (1.5.0) ...
Setting up fonts-font-logos (1.0.1-3) ...
Setting up pve-cluster (8.0.5) ...
Setting up proxmox-kernel-helper (8.0.5) ...
Installing new version of config file /etc/kernel/postinst.d/zz-proxmox-boot ...
Installing new version of config file /etc/kernel/postrm.d/zz-proxmox-boot ...
Setting up libpve-rs-perl (0.8.7) ...
Setting up libproxmox-acme-plugins (1.5.0) ...
Setting up spl (2.2.0-pve3) ...
Setting up libpve-cluster-perl (8.0.5) ...
Setting up libuutil3linux (2.2.0-pve3) ...
Setting up libzpool5linux (2.2.0-pve3) ...
Setting up libpve-notify-perl (8.0.5) ...
Setting up libzfs4linux (2.2.0-pve3) ...
Setting up zfsutils-linux (2.2.0-pve3) ...
Installing new version of config file /etc/default/zfs ...
Installing new version of config file /etc/zfs/zfs-functions ...
Setting up zfs-initramfs (2.2.0-pve3) ...
Setting up libpve-storage-perl (8.0.4) ...
Setting up libpve-access-control (8.0.6) ...
Setting up pve-ha-manager (4.0.3) ...
watchdog-mux.service is a disabled or a static unit, not starting it.
Setting up libpve-cluster-api-perl (8.0.5) ...
Setting up pve-manager (8.0.9) ...
Installing new version of config file /etc/vzdump.conf ...
Setting up zfs-zed (2.2.0-pve3) ...
Installing new version of config file /etc/zfs/zed.d/zed-functions.sh ...
Installing new version of config file /etc/zfs/zed.d/zed.rc ...
Processing triggers for initramfs-tools (0.142) ...
update-initramfs: Generating /boot/initrd.img-6.2.16-19-pve
Running hook script 'zz-proxmox-boot'..
Re-executing '/etc/kernel/postinst.d/zz-proxmox-boot' in new private mount namespace..
No /etc/kernel/proxmox-boot-uuids found, skipping ESP sync.
System booted in EFI-mode but 'grub-efi-amd64' meta-package not installed!
Install 'grub-efi-amd64' to get updates.
Couldn't find EFI system partition. It is recommended to mount it to /boot or /efi.
Alternatively, use --esp-path= to specify path to mount point.
Processing triggers for hicolor-icon-theme (0.17-2) ...
Processing triggers for libc-bin (2.36-9+deb12u3) ...
Processing triggers for man-db (2.11.2-2) ...
Processing triggers for mailcap (3.70+nmu1) ...
Processing triggers for pve-ha-manager (4.0.3) ...
root@pve1:~#
 
That looks good. Then try again with “pveceph install --repository no-subscription” to see if it works now.
 
Code: 
root@pve1:~# pveceph install --repository no-subscription

HINT: The no-subscription repository is not the best choice for production setups.
Proxmox recommends using the enterprise repository with a valid subscription.
This will install Ceph Quincy - continue (y/N)? y
update available package list
start installation
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
ceph-common is already the newest version (18.2.0-pve2).
ceph-fuse is already the newest version (18.2.0-pve2).
gdisk is already the newest version (1.0.9-2.1).
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 ceph-base : Depends: ceph-common (= 17.2.7-pve1) but 18.2.0-pve2 is to be installed
 ceph-mgr : Depends: libsqlite3-mod-ceph (= 17.2.7-pve1) but it is not going to be installed
            Depends: librados2 (= 17.2.7-pve1) but 18.2.0-pve2 is to be installed
E: Unable to correct problems, you have held broken packages.
apt failed during ceph installation (25600)
root@pve1:~#

It is pretty weird, it is trying to install Quincy and I checked the deb :

Code: 
root@pve1:~# cat /etc/apt/sources.list.d/ceph.list
deb http://download.proxmox.com/debian/ceph-quincy bookworm no-subscription
root@pve1:~#


It changed the deb to Quincy, should I change to Reef again ?
 
Code: 
pve-manager (8.0.7) bookworm; urgency=medium

  * ui: ceph wizard: switch to reef as default release for new setups

You have installed "8.0.9", so it should actually be "reef". The server may need a reboot to make the change or it may no longer work automatically because it is not a new installation.

Then try "pveceph install --version reef --repository no-subscription" and see if it does it correctly.
 
Reboot has been done.


It works !

Code: 
installed ceph reef successfully!

reloading API to load new Ceph RADOS library...
root@pve1:~#


Code: 
root@pve1:~# ceph -s
  cluster:
    id:     bf23acb2-77ea-4ae7-843d-607358a0d582
    health: HEALTH_OK

  services:
    mon: 1 daemons, quorum pve1 (age 6s)
    mgr: no daemons active
    osd: 0 osds: 0 up, 0 in

  data:
    pools:   0 pools, 0 pgs
    objects: 0 objects, 0 B
    usage:   0 B used, 0 B / 0 B avail
    pgs:

root@pve1:~#

I will do the same with my other nodes, thanks a lot ! ;)
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom