proxmox 9.0 no keyring found at /var/lib/ceph/osd/ceph-34/keyring, disabling cephx

[cola16]

I'm upgrading proxmox to 9.0

There are three proxmox.

I upgraded one of these.

I may remember wrongly, but all the osd worked at this time.

But when the second node is restarted after upgrading, all the osd upgraded to proxmox 9.0 does not work.

I'm using partition osd, not lvm.
ceph-volume raw activate --osd-id $osdno --no-systemd;
When I used proxmox8, I did systemctl restart ceph-osd after executing the above command.

But after uploading it to 9.0

It doesn't work

I can't proceed with the next result for more than 30 minutes.

Running command: /usr/bin/ceph-authtool --gen-print-key

 

[cola16]

```
root@pve1:~#set osdno 54; ceph-volume raw activate --osd-id $osdno --no-systemd 23:43:59
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph-authtool --gen-print-key
--> KeyError: 'device'
```

```
ceph-volume raw activate --osd-id 11 --osd-uuid d0526922-321d-499e-a64c-ba97d3f12698
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph-authtool --gen-print-key
--> KeyError: 'device'
```

 

[cola16]

I don't know if it's necessary in proxmox 9.0 or ceph 19.2.3.

However, one option should be added when executing the command.

The following is the command that operated until proxmox 8+ ceph 19.2.2
ceph-volume raw activate --osd-id $osdno --no-systemd;

The command to be used now is as follows.
ceph-volume raw activate --osd-id $osdno --no-systemd --device “block device”

Even the --block.db option is not applicable, so you have to make a simlink manually.