ceph

Hello, I'm managing a cluster of 4 nodes using proxmox 7.4-17 with CEPH. After a messy shutdown caused by a long power outage, a couple of VM images were corrupted, but we could restore them from backup. However, two of the OSD services refuse to come back, showing this kind of error: Apr 18...

I have set up a Proxmox 8 ceph cluster with an EC pool called tsPool1. Now I want to connect an independent standalone proxmox 8 host to that cluster using rbd. I used the GUI Datacenter->Storage-> Add feature to setup the storage. The storage is created but I only get a connect when I use...

Hi, i must restore an old 3 node cluster. Which dirs do i have to backup for the cluster restores exactly like was before (configuration, files...). Which is the correct procedure to recover it? Thank you

I have an existing ProxMox Ceph cluster with ceph v18.2.1. I want to add a new host to the cluster but the ceph version it installs is 18.2.2 so I get warnings about a mismatch. How do I install the 18.2.1 version on my new host? The command I'm using is: pveceph install --repository...

Proxmox noob here - I've been asked to setup a 3 node PVE 8.1.10 cluster specifically to investigate options for monitoring with our NMS. First install, I hit the (apparently) well known CEPH v18.2 (Reef) dashboard compatibility problem, and subsequently rebuilt the cluster and installed CEPH...

We'd been having issues with a particular (Synology) Hyper Backup quite some time. Synology support analyzed the log files and told us that there's no ETag returned after a multi-part upload: 2023-11-21T13:20:55+01:00 NAS img_worker[20149]: (20149) [err] transfer_s3.cpp:355 ETag is empty...

Hi, Long shot.... Trying to repair the questionable decision to reinstall for upgrade from 7.4.x and to 8.1.4. Question: Why is the iperf3 showing these issues? Not necessarily even a problem, but still very strange results. Background: 4 host machines 256 core in total 2TB RAM, all...

Doing this all on the command line to create a VM on a Ceph storage. Hoping this is a simple fix. qm create ... qemu-img create rbd:Ceph/vm-998-disk-0 41G Formatting 'rbd:Ceph/vm-998-disk-0', fmt=raw size=44023414784 When I run the following command, I get this error: # qm disk import 998...

I have a three node cluster. Each node is an HP 600 G6 DM with the built in 1GbE port and a 10GbE add on through the Flex IO port. Each nodes gigabit port is connected to my UniFi Dream Machine on the 10.0.2.0/24 (VLAN2) network. The three 10GbE connections are connected to a USW-Flex-XG. I plan...

So I have some servers where I am trying to setup the ssd to utilize erasure-coding. Problem is there are hdd's on as well and I needed to set the device class to ssd.. So using the instructions I was able to create the profile I wanted using the following command ceph osd erasure-code-profile...

Hello ! I am receiving a lot of email about Offline_Uncorrectable in my SSD, in different servers and multiple devices. The following warning/error was logged by the smartd daemon: Device: /dev/sdc [SAT], 16 Offline uncorrectable sectors Device info: HFS1T9G32FEH-BA10A...

Hello everyone We have gotten this failure on our 3 nodes cluster and I really don't know how to solve it. I would really appreciate the help. Thanks in advance

Long story short... not possible. I'm planning to install and use ceph and HA in my working cluster enviroment. I have 4 nodes with 256GB RAM each and 2x10G NICs dedicated for ceph cluster network traffic. I already know this may be not enough for perfect performance so I'm planning to swap NICs...

I need to create a new VM (250+ actually) that uses Ceph storage. To create a disk on non-Ceph storage: echo "----- Creating the disk -----" qemu-img create -f qcow2 $DISK $STORAGE_SIZE How do I create a disk on Ceph storage?

Hello, I'm excited to share that I've successfully migrated and imported two virtual machines from an existing KVM ovirt environment to a new hyperconverged Proxmox setup, utilizing an external Ceph cluster, which also operates as a KVM environment. Leveraging the Proxmox migration guidelines...

Hello, I have a system landscape where I have set up a ProxmoxVE instance and an external Ceph cluster in Quorum 3. From there, I migrated two VMs, along with their disks, from an already existing oVirt KVM landscape to ProxmoxVE for testing purposes, using the CLI utilities provided by...

Hello! We have recently installed a PVE cluster with three nodes and want to use Cephs. The hosts are (almost) identical. Host 3 has a different network interface. We have a public network channel and an exclusive cluster network channel for Ceph. Each host has four discs for OSDs. Creating...

Greetings community! After few month of using ceph from Proxmox i decided to add new disk and stuck with this issue. ceph version 17.2.7 (2dd3854d5b35a35486e86e2616727168e244f470) quincy (stable) Running command: /usr/bin/ceph-authtool --gen-print-key Running command: /usr/bin/ceph --cluster...

Hi everyone, long time lurker but hey, there's a first time at anything right? So i have posted about a problem i'm facing on the proxmox reddit, and someone PM'd me to post it also here, so here's a copypasta of the original post with added all the things they told me to try over there, hope...

root@pve1:~# sudo cat /etc/ceph/ceph.conf [global] auth_client_required = cephx auth_cluster_required = cephx auth_service_required = cephx cluster_network = 192.168.65.10/24 fsid = 5dcbd126-d511-4e12-a653-fee67d7ec467 mon_allow_pool_delete =...