[SOLVED] Unable to create OSD

[scuppasteve]

I am relatively new to Proxmox. I had Ceph installed and fully configured and for learning purposes i tried removing it. I removed the Ceph install and rebuilt the whole Ceph setup. I have all the nodes online, but i can't create an OSD. The drives are wiped.

NAME                 MAJ:MIN RM  SIZE RO TYPE MOUNTPOINTS
sda                    8:0    0  3.7T  0 disk
├─sda1                 8:1    0 1007K  0 part
├─sda2                 8:2    0    1G  0 part /boot/efi
└─sda3                 8:3    0  3.7T  0 part
  ├─pve-swap         252:0    0    8G  0 lvm  [SWAP]
  ├─pve-root         252:1    0  200G  0 lvm  /
  ├─pve-data_tmeta   252:2    0 15.9G  0 lvm
  │ └─pve-data-tpool 252:4    0  3.5T  0 lvm
  │   └─pve-data     252:5    0  3.5T  1 lvm
  └─pve-data_tdata   252:3    0  3.5T  0 lvm
    └─pve-data-tpool 252:4    0  3.5T  0 lvm
      └─pve-data     252:5    0  3.5T  1 lvm
nvme0n1              259:0    0  3.7T  0 disk

I am trying to install this on my NVME drive

root@swarm01:~# pveceph osd create /dev/nvme0n1
create OSD on /dev/nvme0n1 (bluestore)
wiping block device /dev/nvme0n1
200+0 records in
200+0 records out
209715200 bytes (210 MB, 200 MiB) copied, 0.164907 s, 1.3 GB/s
Running command: /bin/ceph-authtool --gen-print-key
Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new 6c55bf9b-36d9-4fae-8a81-dfe5cda4d4ba
 stderr: 2025-03-14T14:08:15.817-0700 7a36e2e006c0 -1 auth: unable to find a keyring on /etc/pve/priv/ceph.client.bootstrap-osd.keyring: (2) No such file or directory
 stderr: 2025-03-14T14:08:15.817-0700 7a36e2e006c0 -1 AuthRegistry(0x7a36dc064298) no keyring found at /etc/pve/priv/ceph.client.bootstrap-osd.keyring, disabling cephx
 stderr: 2025-03-14T14:08:15.822-0700 7a36dbe006c0 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
 stderr: 2025-03-14T14:08:15.823-0700 7a36db4006c0 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
 stderr: [errno 13] RADOS permission denied (error connecting to the cluster)
-->  RuntimeError: Unable to create a new OSD id
command 'ceph-volume lvm create --data /dev/nvme0n1' failed: exit code 1

I am not sure what my issue is or how to fix it.

 

[scuppasteve]

Just had to do the following

ceph auth get client.bootstrap-osd > /var/lib/ceph/bootstrap-osd/ceph.keyring