ceph

My ceph installation is damaged beyond repair. There are several services that are running to exhaustion and not making any progress. One node was in "rebooting" mode for over an hour. I would like to completely redeploy my ceph without having to perform a complete reinstall on each node.

I'm trying to reproduce a configuration in my ESX environment. Essentially I deploy a service/app VM which is immutable and mount/bind a mutable storage volume. Deploying upgrades is as simple as creating V2 of the VM, binding/mounting the storage volume and then stopping the old VM and starting...

I'm attempting to do a test to replicate a ceph image to a remote cluster by following this HOWTO. However, what I'm missing is the detail of how or where to specify where "site-a" is in the examples given in terms of ip address. When I follow the instructions, I see this in the status logs...

We have a 4 nodes CEPH cluster that's normally quite stable. In the last three weeks, one of the nodes has failed in an abnormal way (like complete shutdown of the server). Even with console level access to the device, I couldn't do anything on this server and had to power-reset the server to...

Hi, We use the following tutorials to get radosGW work : https://devopstales.github.io/home/proxmox-ceph-radosgw/ https://pve.proxmox.com/wiki/User:Grin/Ceph_Object_Gateway Everything seems to work perfectly I can navigate, create a bucket and add object with the following tools (using V2)...

We are getting serious now. The boss wants "Proxmox VSAN". I sold it. Now I gotta deliver. Gonna take two of the big all-SSD R840 hosts out of production and use em for a new CEPH cluster. It's not happening today, by any means. I'm gonna build it out in the lab. Demo it. _Test_ it. When...

I'm very new to Ceph and have been trying to synthesize the instructions to create a 3 node full mesh routed (with fallback) cluster using Minisforum MS-01's (2x10Gbe + 2x 2.5Gbe): https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server#Routed_Setup_(with_Fallback)...

Hello, I've added some more drives to our 3 node ceph cluster, started creating OSDs and accidently created LVM,CEPH (DB) disk instead of OSD. I do not need a seperate DB disk. How can i destroy it and re-create it to regular OSD? Actually i did the same mistake on two nodes. Here's output...

Hi everyone, I would like some help regarding CEPH topology. I have the following environment: - 5x Servers (PVE01,02,03,04,05) - PVE 01,02, and 03 in one datacenter and PVE04 and 05 in another datacenter. - 6x Disks in each (3x HDD and 3x SSD) - All of the same capacity/model. I would like...

Hello there! I'm trying to configure a Proxmox cluster using a VPN from 2 different geographic sites with a total of 3 nodes. I'd like to enable Ceph cluster using ODS disks but it looks like ceph Monitors and ODS configurations need to use a network in the same segment like 192.168.2.0/24 If...

Hi. I have a brand new four-node Proxmox cluster up and running. I've configured a CEPH pool called "StandardStorage" (3:2) where the two VMs are stored. The target for the backup is called PLFS2Storage, an NFS mount. Running "Backup" from the node -> Virtual Machine page fails because it...

Hello and thank you for your time. TL;DR - Can a Ceph disk be used as a Windows Failover Cluster Shared Volume? If yes, what particular VM configurations need to be made in order to make the WFC accept the disk? Related forum threads - Support for Windows Failover Clustering, hpe 1060 stroage...

This morning a loss of power to the one of the servers in the ceph cluser knocked out the cluster. After I got that server up and running again, the ceph cluster started to recover. And at that time I could see the OSD's in the OSD tab. But it got to 72.36% and the recovery stopped, and I can no...

After going down many rabbit holes, I have finally come to the conclusion that the best solution (for my office) is a Proxmox cluster with 4 nodes. Depending on my final build, I might be able to only have 3. For now, I will use both proxmox backup and veeam to backup my VMs to a TrueNAS box...

Hello! I'm testing Ceph setup on single node, 12 HDDs are connected via SAS9211-4i contoller: root@pve-1:~# ceph osd tree ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 32.74786 root default -3 32.74786 host pve-1 0 hdd 2.72899 osd.0...

Good Day All. Im new to ceph. i have set up a 6 node cluster. Its a mixture of SSD AND sas drives. With the sas drives i use a ssd partition for the db. Now what im experiencing is that my VMs are slow. Boot is slow Opening programs are slow etc etc. the 10.0.45.0/24 network is 10Gig the...

Hi, A client want to have 3 nodes in 3 datacenter with iSCSI local storage connected, it's possible to configure on the top one shared storage for all hosts?? CEPH??

Once I had 4 nodes running with Ceph and one could fail. Now that one has failed and is removed. Is it possible to establish redundancy with the remaining 3 nodes? From ceph -s data: volumes: 2/2 healthy pools: 7 pools, 193 pgs objects: 139.48k objects, 538 GiB usage: 1.6...

Hi everyone, I'm working with a 3 node cluster running with ceph 17 and I'm about to upgrade. I also add a new node to the cluster and install ceph 18.2 . The first OSD i'm creating seems OK yet after a few moments it's shut down. In the logs here is what I can find : May 18 15:34:44 node4...

Currently, I have 1 disk in each server(total 3) used for Ceph shared storage. I noticed that if 2 out of 3 disks are not working then complete ceph will also stop working. I am not sure if the same (n/2 +1) formula works here as well. Why It is concerning is because we are using CephFS as...