osd

Hello! I have setup (and configured) Ceph on a 3-node-cluster. All nodes have - 48 HDDs - 4 SSDs For best performance I defined any HDD as data and SSD as log. This means I created 12 partitions on each SSD and created an OSD like this on node A: pveceph createosd /dev/sda -journal_dev...

After getting the node up and running again (https://forum.proxmox.com/threads/it-seemed-failed-disks-prevent-proxmox-from-booting-but-it-was-actually-noapic-that-was-needed.43720/) I now have a problem that has been reported a few time elsewhere, but not in the systemd based version of Proxmox...

I am trying to add some new disks to a brand new server that is part of the cluster. When I try to add an OSD i get the following errors. This is running the very latest 5.1-51 with the very latest Ceph 12.2.4 root@virt04:~# pveceph createosd /dev/sdc file '/etc/ceph/ceph.conf' already exists...

Hi to all, I've an enormous problem with ceph. This is my configuration: [global] auth client required = cephx auth cluster required = cephx auth service required = cephx c luster network = 10.10.10.0/30 fsid = 3f50371b-9be3-4af3-8e6d-c42e06ab3d22 keyring =...

Hello, I have a cluster with 3 PCs, each having 3 osd's. It works great so far, but over time (after a few hours / days) the osd's start to go down. The cluster has been in use for about 4 weeks and roughly I lose one osd per day. After it's down it cannot be restarted via ceph commands. Even...

Hello, I have a 3-node ceph cluster and Create OSD Follow this. 1. SSD 3-6 (/dev/sdc-sdh) is ok usable 2. But SSD 1-2 (/dev/sda-sdb) Tab OSD >> is Not applicable and not show osd.xx 3. And SSD 1-2 (/dev/sda-sdb) Tab Disk >> show type usage "parititions" 4. I Delete parititions on SSD...

We have a new four node cluster that is almost identical to other clusters we are running. However, since it has been up and running at what seems to be random times we end up with errors similar to: 2018-02-05 06:48:16.581002 26686 : cluster [ERR] Health check update: Possible data damage: 4...

I'm having a difficult time using a disk in my machine. It is not being used for anything, i've successfully don a sgdisk -Z on the drive and it shows that nothing is on it. Disk /dev/sda: 233.8 GiB, 251000193024 bytes, 490234752 sectors Units: sectors of 1 * 512 = 512 bytes Sector size...

Hi, Recently my datancenter had some issues on VRack level affecting therefor all services depending on this. Also my cluster running proxmox was affected in special CEPH. I receive this error on one of the clusters: root@node02-sxb-pve01:~# service ceph-osd@1 status ● ceph-osd@1.service -...

Hi, I've just updated a 3 nodes pve 5.0 cluster with latest luminous packages. Everything seems to be good after upgrade and reboot but on one node I have weird syslog relative to a "osd.12 service". Oct 12 20:51:32 dc-prox-13 systemd[1]: ceph-osd@12.service: Service hold-off time over...

Hello, I am testing to install Proxmox5 on a OVH dedicated server ( EG - 64G E5-1650v3 ) I have 2 SSD disks. I have issues on creating OSD, as I get a 100MB partition. - ceph version 12.1.1 I already tried to zap the disk with both: - ceph-disk zap /dev/nvme1n1 or (as found in...

Hi, We are using 3 nodes CEPH cluster. One of my node died. I rebuild and added node back to cluster. Cluster is working fine. Now I can't create OSDs. OSD create successfully but showing as partition not as OSD.x under disk. I have removed all data and cleaned partition using following...

Hi, I've some issues with ceph cluster installation. I've 3 physical servers where ceph is installed on each node. On this nodes there is 3 SAS disks and several NIC 10Gbps. One disk has 300GB, where is installed proxmox packages, the other disks have 1TB, available for my osds. But when i...

Hi, My issue is very strange.. I have one cluster of 3 physical servers where is installed Proxmox VE 4.4. I installed on each nodes ceph with 'pveceph install -version hammer' command. I have 3 monitors on the different nodes in my cluster. Each servers have 1 disk of 1TB and an other where...

Hi, I have 3 nodes Proxmox Cluster with Ceph. I'm happy with current setup and performance. Now we are planning Disaster Recovery. We are using separate NFS storage for VM backup. I have few questions and I need expert advice. Our Ceph pools are setup with 2 replica. We have 4 OSDs in each...

Hye guys.. i got some issue here.. Why i can't create ceph osd?? did i missed something? when i tried to create ceph osd, the popup window on Disk column show "NO DISK UNUSED" while on Journal Disk it show "use OSD disk" . Any suggestions guys??

Hello! I'm using ProxMox with no-subscription repository pve-manager/4.4-12/e71b7a74 (running kernel: 4.4.40-1-pve) and installed Ceph via "pveceph install -version jewel" I'm having trouble with Ceph when creating OSDs. I'm using the pveceph utility, as described in...

Hi there, I'm trying to set up a seperated pool with SSD storage within my Ceph. I followed the instructions here (https://elkano.org/blog/ceph-sata-ssd-pools-server-editing-crushmap/), while using pveceph whereever possible. It works in a way that everything was set up and showed fine in the...

Hallo zusammen, ich hoffe mir kann hier jemand bei CephFS weiter helfen: Wie oben geschrieben habe ich das Problem, dass in meinem Proxmox Cluster mit CephFS die Daten auf den OSDs sehr ungleich verteilt werden. Im folgenden das Setup: Aktuell 4 Server (5. ist in Planung). Jeder Server hat...

Hi, i've a 5 Node Proxmox/Ceph Cluster. The OSDs are located at 3 of those 5 Machines. 4 OSDs per Node with P3700 NVMe SSD as journal Devices. My Question is: ceph-disk list should print the OSDs with some infos about journaling. My journal info of each OSD is empty?! Is this ok...