osd

Hi, Today there was an unexpected power outage where my servers are co-located, the entire datacenter went dark. Luckily I had fresh backups to simply restore for the most part. However, I have an issue with one OSD on one server, the OSD is stuck in "active+recovery_wait+degraded" I have...

When using bluestore osds, the backup data stops flowing, the task shows running, but no more data moves. I've swapped all the osds back to file and the backups work perfectly. Also backups stop if there is any osd using bluestore. Syslog: only errors reported: Sep 24 22:58:35 proxmox3...

today I added some new HDDs to our storage nodes. All HDDs are Seagate IronWolf 8TB. As you see attached, the new HDDs are shown with a different size. Only difference I know is I created the old OSD with cep-volume by myself, not within the GUI. I used cep-volume because cep-disk is deprecated...

Hi, I have created 3 OSDs on the same node. root@ld4257:~# pveceph createosd /dev/sda -bluestore -journal_dev /dev/sdc4 -wal_dev /dev/sdc4 create OSD on /dev/sda (bluestore) using device '/dev/sdc4' for block.db Caution: invalid backup GPT header, but valid main header; regenerating backup...

Hello! I have setup (and configured) Ceph on a 3-node-cluster. All nodes have - 48 HDDs - 4 SSDs For best performance I defined any HDD as data and SSD as log. This means I created 12 partitions on each SSD and created an OSD like this on node A: pveceph createosd /dev/sda -journal_dev...

After getting the node up and running again (https://forum.proxmox.com/threads/it-seemed-failed-disks-prevent-proxmox-from-booting-but-it-was-actually-noapic-that-was-needed.43720/) I now have a problem that has been reported a few time elsewhere, but not in the systemd based version of Proxmox...

I am trying to add some new disks to a brand new server that is part of the cluster. When I try to add an OSD i get the following errors. This is running the very latest 5.1-51 with the very latest Ceph 12.2.4 root@virt04:~# pveceph createosd /dev/sdc file '/etc/ceph/ceph.conf' already exists...

Hi to all, I've an enormous problem with ceph. This is my configuration: [global] auth client required = cephx auth cluster required = cephx auth service required = cephx c luster network = 10.10.10.0/30 fsid = 3f50371b-9be3-4af3-8e6d-c42e06ab3d22 keyring =...

Hello, I have a cluster with 3 PCs, each having 3 osd's. It works great so far, but over time (after a few hours / days) the osd's start to go down. The cluster has been in use for about 4 weeks and roughly I lose one osd per day. After it's down it cannot be restarted via ceph commands. Even...

Hello, I have a 3-node ceph cluster and Create OSD Follow this. 1. SSD 3-6 (/dev/sdc-sdh) is ok usable 2. But SSD 1-2 (/dev/sda-sdb) Tab OSD >> is Not applicable and not show osd.xx 3. And SSD 1-2 (/dev/sda-sdb) Tab Disk >> show type usage "parititions" 4. I Delete parititions on SSD...

We have a new four node cluster that is almost identical to other clusters we are running. However, since it has been up and running at what seems to be random times we end up with errors similar to: 2018-02-05 06:48:16.581002 26686 : cluster [ERR] Health check update: Possible data damage: 4...

I'm having a difficult time using a disk in my machine. It is not being used for anything, i've successfully don a sgdisk -Z on the drive and it shows that nothing is on it. Disk /dev/sda: 233.8 GiB, 251000193024 bytes, 490234752 sectors Units: sectors of 1 * 512 = 512 bytes Sector size...

Hi, Recently my datancenter had some issues on VRack level affecting therefor all services depending on this. Also my cluster running proxmox was affected in special CEPH. I receive this error on one of the clusters: root@node02-sxb-pve01:~# service ceph-osd@1 status ● ceph-osd@1.service -...

Hi, I've just updated a 3 nodes pve 5.0 cluster with latest luminous packages. Everything seems to be good after upgrade and reboot but on one node I have weird syslog relative to a "osd.12 service". Oct 12 20:51:32 dc-prox-13 systemd[1]: ceph-osd@12.service: Service hold-off time over...

Hello, I am testing to install Proxmox5 on a OVH dedicated server ( EG - 64G E5-1650v3 ) I have 2 SSD disks. I have issues on creating OSD, as I get a 100MB partition. - ceph version 12.1.1 I already tried to zap the disk with both: - ceph-disk zap /dev/nvme1n1 or (as found in...

Hi, We are using 3 nodes CEPH cluster. One of my node died. I rebuild and added node back to cluster. Cluster is working fine. Now I can't create OSDs. OSD create successfully but showing as partition not as OSD.x under disk. I have removed all data and cleaned partition using following...

Hi, I've some issues with ceph cluster installation. I've 3 physical servers where ceph is installed on each node. On this nodes there is 3 SAS disks and several NIC 10Gbps. One disk has 300GB, where is installed proxmox packages, the other disks have 1TB, available for my osds. But when i...

Hi, My issue is very strange.. I have one cluster of 3 physical servers where is installed Proxmox VE 4.4. I installed on each nodes ceph with 'pveceph install -version hammer' command. I have 3 monitors on the different nodes in my cluster. Each servers have 1 disk of 1TB and an other where...

Hi, I have 3 nodes Proxmox Cluster with Ceph. I'm happy with current setup and performance. Now we are planning Disaster Recovery. We are using separate NFS storage for VM backup. I have few questions and I need expert advice. Our Ceph pools are setup with 2 replica. We have 4 OSDs in each...

Hye guys.. i got some issue here.. Why i can't create ceph osd?? did i missed something? when i tried to create ceph osd, the popup window on Disk column show "NO DISK UNUSED" while on Journal Disk it show "use OSD disk" . Any suggestions guys??