ceph

Hi, Has anyone experimented with ceph stretch pools that seem to have appeared in squid? (not stretched clusters) It seems rather new, but rather interesting, as it may not require the whole cluster to be set to stretched, while still dealing with the guarantee of OSDs and monitors being on...

Hi I have a quick question about Ceph. Originally when i installed Proxmox I had added all versions of Ceph repo. I added Quincy and Reef and Squid repositories, honestly i don't know much about Ceph and didn't think much of it when adding all 3 version repo's, and don't know if anything was...

Hello all, I have a 3-node cluster set up using the guide here: https://packetpushers.net/blog/proxmox-ceph-full-mesh-hci-cluster-w-dynamic-routing/ Everything was working fine when using Ceph Quincy and Reef. However, after updating to Squid, I now get this error in the health status...

Hello. I have three similar computers. Each of them has 2 similar-size disks. I installed PVE on one of the computers and configured its two disks as a ZFS mirror during installation. I recently did the same on a second computer and joined them as a cluster. I was about to do the same for...

Ceph is great, but it needs some resources above the theoretical minimum to work reliably. My assumptions for the following text: you want to use Ceph because... why not? you want to use High Availability - which requires Shared Storage (note that a complete solution needs more things like a...

Hello, i am planning to move my one node Proxmox server with VMs to a new 3 node Cluster with Ceph Pool. Now are my questions: 1. Whats the best way to move the VMs to the according Ceph Pools on the Cluster, with minimal downtime. 2. Is there a way for testing to just copy a VM from the...

Merry Christmas, everyone, if that's what you're into. I have been using Ceph for a few months now and it has been a great experience. I have four Dell R740s and one R730 in the cluster, and I plan to add two C240 M4s to deploy a mini-cloud at other locations (but that's a conversation for...

Dear All, I have a 8 node Proxmox with 8.3.2 and CEPH storage, now planning to add more disk to the CEPH Like to refer the documentation and understand how to do it Requesting the URL for adding the disk to the CEPH cluster thanks Joseph John

Hello everyone, I have been using Ceph for the past few months and have recently acquired the necessary hardware to set up Ceph on its subnet, as advised in the Ceph and Proxmox documentation. I am unsure if I have configured this correctly. Below is my configuration file, where you will also...

Hello, I want to cycle / renew all CEPH keyrings across the cluster as part of my security maintenance procedures. My environment Proxmox VE 8.2.8 CEPH 18.2.4 Components where I want to cycle the keyrings MON & client.admin MGR MDS Current situation I tried to rotate the keys in the...

I want some advice regarding CEPH. I like to use it in the future when I have a 3 node cluster. The idea is to have 2 NVME ssd's per node. 1 1TB ssd for the OS and 1 4TB ssd for the CEPH storage. Is this a good approach? Btw I'm think of WD SN850X or Samsung 990 Pro SSD's

I’m running a 5-node Proxmox cluster on version 7.4.19 with two storage pools: one on spindle drives and the other on SSDs. Both pools host live VMs, but performance is slower than expected, with high IOWait states. I’ve read that enabling KRBD can improve performance, but I haven’t found clear...

We use the PVE8.2+CEPH hyper-converged architecture in the production environment, with a total of 8 physical nodes. These 8 physical nodes use exactly the same hardware configuration. THE SERVER MODEL IS DELL R750 However, in the past six months or so, there has been a physical node crash, and...

Hello, I work for multiple clients and one of them wanted us to create a Proxmox cluster to assure them fault tolerance and a good hypervisor that's cost-efficient. It's the first time we put a Proxmox cluster in Production environment for a client. We've only used single node proxmox. Client...

I think the answer is "no", but I wanted to check whether there was support in the "pveceph pool create" command to specify which erasure code plugin it should use - specifically "clay". Or, would we need to create the pool in ceph manually and add it as specified here...

I have a 2 node cluster running ceph (I know that's not ideal). On one machine, the ceph mon service frequently keeps crashing. Looking at the syslogs for the last crash, it was preceded by: Dec 09 00:00:46 <node> ceph-mon[1207324]: 2024-12-09T00:00:46.474-0800 7ebf05a006c0 -1 received...

I think the subject says it all. I'm looking for a guide that shows a step by step on how to create an NVMEoF pool with a Ceph cluster managed by Proxmox VE. I tried following the guide at: https://docs.ceph.com But I didn't get far because it says right in the requirements that the Ceph...

Moin, mit ist ein Verhalten aufgefallen: Wenn ich ISOs von PVE in den CEPH Storage downloaden lasse, verlieren wohl einige OSDs die Verbindung. Nicht aber z.B. bei VM Restore auf CEPH Storage. RADOS Benchmarks ergeben auch keine Fehler Ich habe zunächst 3 Screenshots, was ich noch an...

Hi, I have a 3x node Proxmox cluster running ceph with a mixture of NVMe and SAS hard drives built from some used hardware. I've logged into the dashboard this morning and was greeted with an error in the CEPH dashboard saying 'Possible data damage: 1 pg inconsistent'. I've tried a few things...

Hello, I am experiencing an issue with configuring the MTU for the interface used by Ceph. When I set the MTU to 9000 on both the server interface and the physical switch, I can successfully ping with a maximum packet size of 8958. However, I am unable to access resources in the Ceph cluster...