ceph

Hello, 3 nodes, identical, new installation from latest ISO, upgraded all nodes, added ceph reef sources. I installed ceph on all 3 hosts individually. It came online, green initiall (well also now it is green), but only on node 1 the manager is running and it is green, node 2 and 3 are in...

ceph version 18.2.2 (e9fe820e7fffd1b7cde143a9f77653b73fcec748) reef (stable) Hello everyone, please we need your help to import the bluestore OSDs to the new cluster, because after trying to import, we noticed that the OSDs do not start. They are only in a "down" state and are imported as...

I have A ceph on 3 node working for a year. I get a HEALTH_WARN about : 2 OSD have spurious read erros 1/3 mons down, quorum ceph01,ceph03 I tried to start mon on ceph02. But not working. xxxxxxx@ceph02:~# systemctl status ceph-mon@ceph02 ● ceph-mon@ceph02.service - Ceph...

We uploaded two ISOs on June 11 via the proxmox GUI and made use of the checksum matching feature while doing so. root@pve1:/var/log/pve/tasks# pvenode task list --type imgcopy...

so i cant attach the screenshots for some reason so ill just copy paste it over here -First issue root@CIS-Node6:\~# ceph dashboard create-self-signed-cert no valid command found; 10 closest matches: pg stat pg getmap pg dump...

I have a cluster of 3 PVE nodes with a Ceph pool hosted between them for VM and container disk images. I recently updated from PVE 7 to 8 and Ceph Pacific to Reef. Specifically, I did the following: Update PVE to the latest v7 Update Ceph from Pacific to Quincy as per the wiki instructions...

hey all! I was trying to add another box to my clusters but I messed up the addressing and caused it to fail but now i cant remove it. Is this something that can be manually removed? Thank you !

Dears, I'm preparing to buy 3 Dell servers for our Proxmox Cluster. I am planning to use CEPH storage for the Cluster. I would like to know whether CEPH storage can work with a RAID controller, but the disks for CEPH will be configured in NON-RAID mode. I want to use RAID controller because I...

Hello, I would be very grateful for some help, I have been trying to setup an rbd mirror on a pool between two proxmox ceph clusters. I have followed the instructions here : https://pve.proxmox.com/wiki/Ceph_RBD_Mirroring And also here : https://satishdotpatel.github.io/ceph-rbd-mirroring/...

My ceph installation is damaged beyond repair. There are several services that are running to exhaustion and not making any progress. One node was in "rebooting" mode for over an hour. I would like to completely redeploy my ceph without having to perform a complete reinstall on each node.

I'm trying to reproduce a configuration in my ESX environment. Essentially I deploy a service/app VM which is immutable and mount/bind a mutable storage volume. Deploying upgrades is as simple as creating V2 of the VM, binding/mounting the storage volume and then stopping the old VM and starting...

I'm attempting to do a test to replicate a ceph image to a remote cluster by following this HOWTO. However, what I'm missing is the detail of how or where to specify where "site-a" is in the examples given in terms of ip address. When I follow the instructions, I see this in the status logs...

We have a 4 nodes CEPH cluster that's normally quite stable. In the last three weeks, one of the nodes has failed in an abnormal way (like complete shutdown of the server). Even with console level access to the device, I couldn't do anything on this server and had to power-reset the server to...

Hi, We use the following tutorials to get radosGW work : https://devopstales.github.io/home/proxmox-ceph-radosgw/ https://pve.proxmox.com/wiki/User:Grin/Ceph_Object_Gateway Everything seems to work perfectly I can navigate, create a bucket and add object with the following tools (using V2)...

We are getting serious now. The boss wants "Proxmox VSAN". I sold it. Now I gotta deliver. Gonna take two of the big all-SSD R840 hosts out of production and use em for a new CEPH cluster. It's not happening today, by any means. I'm gonna build it out in the lab. Demo it. _Test_ it. When...

I'm very new to Ceph and have been trying to synthesize the instructions to create a 3 node full mesh routed (with fallback) cluster using Minisforum MS-01's (2x10Gbe + 2x 2.5Gbe): https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server#Routed_Setup_(with_Fallback)...

Hello, I've added some more drives to our 3 node ceph cluster, started creating OSDs and accidently created LVM,CEPH (DB) disk instead of OSD. I do not need a seperate DB disk. How can i destroy it and re-create it to regular OSD? Actually i did the same mistake on two nodes. Here's output...

Hi everyone, I would like some help regarding CEPH topology. I have the following environment: - 5x Servers (PVE01,02,03,04,05) - PVE 01,02, and 03 in one datacenter and PVE04 and 05 in another datacenter. - 6x Disks in each (3x HDD and 3x SSD) - All of the same capacity/model. I would like...

Hello there! I'm trying to configure a Proxmox cluster using a VPN from 2 different geographic sites with a total of 3 nodes. I'd like to enable Ceph cluster using ODS disks but it looks like ceph Monitors and ODS configurations need to use a network in the same segment like 192.168.2.0/24 If...

Hi. I have a brand new four-node Proxmox cluster up and running. I've configured a CEPH pool called "StandardStorage" (3:2) where the two VMs are stored. The target for the backup is called PLFS2Storage, an NFS mount. Running "Backup" from the node -> Virtual Machine page fails because it...