ceph

Hi there, the Title may be a bit deceptive as I know there are good solutions that work for many but for me/my workplace we face a bit of a dilemma. I know I'm opening this can of worms again and this is also partly me venting a bit of my frustration and I'm sorry about that. We wanna use...

I am on the latest proxmox 9.1.5 with ceph 19.2.3 squid. These warnings bothering me a lot and I am scared to touch anything related to ceph. systemd‑sysv‑generator: SysV service '/etc/init.d/ceph' lacks a native systemd unit file… Please update package to include a native systemd unit file...

Environment Proxmox VE cluster with 2 nodes (node94: 10.129.56.94, node107: 10.129.56.107) Ceph cluster running on the Proxmox nodes (public_network: 10.129.56.0/24) Proxmox SDN EVPN zone (madp) for VM networking VMs are on the EVPN overlay network: 172.16.0.0/16 Goal: Configure Rook External...

Hi! I’m planning to migrate from TrueNAS to Ceph because I want node-based redundancy. I was planning to use HDDs with an SSD cache tier on top to boost performance, since I work with heavy file sequences and want to saturate my 10 Gbit network. However, I found that the cache tier is...

Hello all i have a 3 node proxmox cluster with ceph. each node has 2x 4tb samsung 870 QVO ssds. I have noticed my vms being really slow and i was wondering how much of that is because of the ssds. I have checked my network and everything else. Im here to just confirm if what AI assistant is...

Hello everyone, I need your support. We recently updated our cluster to versions PVE 8.4.16 and CEPH 17.2.8, and only after the update did we read an article that said we need to urgently upgrade from this version because there's a critical error with bluestore. Can you tell me if the error is...

Schönen guten Morgen, ich habe hier eine HA Cluster mit CEPH-Storage im Betrieb. Auf 3 Nodes verteilt laufen ca. 30 VEs (Linux, Windows). Hardware:CPUs, RAM und Storage ausreichend vorhanden. Seit einiger Zeit kann ich, auch bei ausgeschalteter VE die Größe des RAMs nicht ändern. Weder...

Hallo, ich möchte meinen 3 Nodes Cluster mit je 2 x 25Gb ( bond0 LACP) von Switch auf Full Mesh über direkte Verbindung umstellen. Da ich keine NICs mehr frei habe, ist es von meinem Verständnis her nicht so ganz einfach... ...oder doch nicht? Deswegen meine Frage: Ist es möglich ein Openfabric...

For the past few weeks, I’ve been experiencing a recurring issue with one of our VMs during backup: - The backup fails on a specific VM, and afterward, the filesystem on the VM switches to read-only mode (screenshot available). - The CPU usage then spikes to 100% until I force a shutdown. -...

Hi I have 3 node cluster with 2 x Kioxia 1,92TB SAS Enterprise SSD. Disk operation on VM's are very slow. Network config is as follow: Each node have: 1 x 1Gb NIC for Ceph public network (the same network as proxmox itself) 1 x 10Gb NIC for Ceph cluster network I'm no expert in ceph and...

Since we upgrade our production Proxmox version from 8.2.x to 8.4.14 and ceph form version 18.2.1 to 19.2.3, we were observing slow OSDs since day 2 of upgrade. We have daily backup of our production VMs from PVE to PBS starting from hour 2100 to ~0400. When its time for Database VM backup(time...

Hi guys! Newbie here, so please be gentle :) In the Ceph installer (Proxmox VE 9, 3 node cluster), when I have to choose the "ceph-public" and "ceph-cluster" network it only let's me choose the local IPs of my configured NICs (I have installed dedicated NICs for ceph-public and ceph-cluster)...

I want to create a LXC or VM via API. Currently working on LXC. BUT I noticed first of all the api doc is plain... bad imo . Anyways. I NEED to add a rootfs for lxc because ofc I do?! And I am using CEPH for my cluster. So I want to create for example a disk of 1G on Ceph Storage CL1. Can I do...

Dear Community, I've experienced many issues with PVE 9.1 and the new kernel 6.17. I'm unable to name all exactly but there were I/O hangs, kernel stack traces and so on. 6.17.2-1-pve was worst, it got a bit better with 6.17.2-2-pve. Yesterday I had I/O timeouts while the PBS backup was...

In the Ceph Squid, I created the RBD image of 200GB in Ceph Mgr Dashboard. And I mounted that RBD image and stored the data of 10GB. Then the dashboard shows the usage as 5%. And then I created the snapshot of that RBD image. Then the dashboard shows the RBD image usage as 0% even though there...

I'm seeing crazy low performance in Ceph. I've traced it to OSD's sometimes being very slow...see below. In 3 tests, the first is fairly slow, then fast (as fast as I expect this OSD to be), then the 3rd is crazy slow. root@pm3:~# ceph tell osd.3 bench { "bytes_written": 1073741824...

In our cluster there are currently three hosts with four 3.84TB RI OSDs each. I want to replace the four OSDs with 3.2TB MU SSDs, eventually adding a fifth OSD (later on). Currently there is only around 2.2TB used per OSD so this should work. CEPH version is 19.2.3-pve2...

Hello, this is my first post. I have 3 Dell OptiPlex 7060 Micro which I have upgraded and each of the computers has the following specifications: - 4TB M.2 NVMe - 4TB SATA SSD - 512GB M.2 NVMe Now what I want is to make a CEPH pool with the 3 machines and using only the 512GB disks so I...

Dear, I am facing to a choice to share the existing ceph storage from proxmox cluster to K3S cluster. Is it best practice to do that or need to SoC and each cluster has his own storage ? If proxmox manage the ceph storage is it a good governance ? Some clarifications are welcome. Best Regards,

Hey all, I'm the administrator for a bunch of servers here at the university (both students and researchers). We have quite a lot of data science / machine learning projects, and we store the data in locally hosted S3 buckets. For the last few years, I have just been spinning up a separate...