ceph

Hello all i have a 3 node proxmox cluster with ceph. each node has 2x 4tb samsung 870 QVO ssds. I have noticed my vms being really slow and i was wondering how much of that is because of the ssds. I have checked my network and everything else. Im here to just confirm if what AI assistant is...

Hello everyone, I need your support. We recently updated our cluster to versions PVE 8.4.16 and CEPH 17.2.8, and only after the update did we read an article that said we need to urgently upgrade from this version because there's a critical error with bluestore. Can you tell me if the error is...

Schönen guten Morgen, ich habe hier eine HA Cluster mit CEPH-Storage im Betrieb. Auf 3 Nodes verteilt laufen ca. 30 VEs (Linux, Windows). Hardware:CPUs, RAM und Storage ausreichend vorhanden. Seit einiger Zeit kann ich, auch bei ausgeschalteter VE die Größe des RAMs nicht ändern. Weder...

Hallo, ich möchte meinen 3 Nodes Cluster mit je 2 x 25Gb ( bond0 LACP) von Switch auf Full Mesh über direkte Verbindung umstellen. Da ich keine NICs mehr frei habe, ist es von meinem Verständnis her nicht so ganz einfach... ...oder doch nicht? Deswegen meine Frage: Ist es möglich ein Openfabric...

For the past few weeks, I’ve been experiencing a recurring issue with one of our VMs during backup: - The backup fails on a specific VM, and afterward, the filesystem on the VM switches to read-only mode (screenshot available). - The CPU usage then spikes to 100% until I force a shutdown. -...

Hi I have 3 node cluster with 2 x Kioxia 1,92TB SAS Enterprise SSD. Disk operation on VM's are very slow. Network config is as follow: Each node have: 1 x 1Gb NIC for Ceph public network (the same network as proxmox itself) 1 x 10Gb NIC for Ceph cluster network I'm no expert in ceph and...

Since we upgrade our production Proxmox version from 8.2.x to 8.4.14 and ceph form version 18.2.1 to 19.2.3, we were observing slow OSDs since day 2 of upgrade. We have daily backup of our production VMs from PVE to PBS starting from hour 2100 to ~0400. When its time for Database VM backup(time...

Hi guys! Newbie here, so please be gentle :) In the Ceph installer (Proxmox VE 9, 3 node cluster), when I have to choose the "ceph-public" and "ceph-cluster" network it only let's me choose the local IPs of my configured NICs (I have installed dedicated NICs for ceph-public and ceph-cluster)...

I want to create a LXC or VM via API. Currently working on LXC. BUT I noticed first of all the api doc is plain... bad imo . Anyways. I NEED to add a rootfs for lxc because ofc I do?! And I am using CEPH for my cluster. So I want to create for example a disk of 1G on Ceph Storage CL1. Can I do...

Dear Community, I've experienced many issues with PVE 9.1 and the new kernel 6.17. I'm unable to name all exactly but there were I/O hangs, kernel stack traces and so on. 6.17.2-1-pve was worst, it got a bit better with 6.17.2-2-pve. Yesterday I had I/O timeouts while the PBS backup was...

In the Ceph Squid, I created the RBD image of 200GB in Ceph Mgr Dashboard. And I mounted that RBD image and stored the data of 10GB. Then the dashboard shows the usage as 5%. And then I created the snapshot of that RBD image. Then the dashboard shows the RBD image usage as 0% even though there...

I'm seeing crazy low performance in Ceph. I've traced it to OSD's sometimes being very slow...see below. In 3 tests, the first is fairly slow, then fast (as fast as I expect this OSD to be), then the 3rd is crazy slow. root@pm3:~# ceph tell osd.3 bench { "bytes_written": 1073741824...

In our cluster there are currently three hosts with four 3.84TB RI OSDs each. I want to replace the four OSDs with 3.2TB MU SSDs, eventually adding a fifth OSD (later on). Currently there is only around 2.2TB used per OSD so this should work. CEPH version is 19.2.3-pve2...

Hello, this is my first post. I have 3 Dell OptiPlex 7060 Micro which I have upgraded and each of the computers has the following specifications: - 4TB M.2 NVMe - 4TB SATA SSD - 512GB M.2 NVMe Now what I want is to make a CEPH pool with the 3 machines and using only the 512GB disks so I...

Dear, I am facing to a choice to share the existing ceph storage from proxmox cluster to K3S cluster. Is it best practice to do that or need to SoC and each cluster has his own storage ? If proxmox manage the ceph storage is it a good governance ? Some clarifications are welcome. Best Regards,

Hey all, I'm the administrator for a bunch of servers here at the university (both students and researchers). We have quite a lot of data science / machine learning projects, and we store the data in locally hosted S3 buckets. For the last few years, I have just been spinning up a separate...

We're in the process of validating a PVE cluster setup that will be deployed to prod some time in 2026, and for that purpose, we've spun up the MVC (Minimum Viable Cluster) that mimicks, except in node count, what we're planning to have by then. As a result, we have three modern Dell boxen with...

Hello everyone, I'm new to Proxmox and would like to set up Ceph, but my server doesn't have direct internet access. Has anyone done this before or have any tips on how to install Ceph offline? Any advice or experiences would be greatly appreciated! Thanks in advance and best regards,

Hello everyone, I have following issue where I would like to define Ceph-Pool quota-thresholds for all thresholds defined within my Ceph-Cluster. These quota-definitions work, but my issue is that warnings and critical notices within the Proxmox-Cpeh dashboard tab are not visible. When following...

A while back I had an event that caused my Ceph cluster to crash. By design I had backups of everything that mattered. However, I wanted to see if I could fix the cluster and maybe try to bring back some VMs that won't start due to the crash. I had a lot of `pgs inactive`, but managed to get...