ceph

Hello, I would like to ask you a few questions about CEPH. Currently, I'm working on critical infrastructure for my client, and I'm planning to use servers with hardware RAID. My first question is whether I should opt for CEPH or classic RAID on these servers? The second question is whether it's...

Good Day All. I have just set up a 4 node cluster with Ceph. So a few Questions to help me understand what is happening 1. I know data is stored over multiple servers. However, when I run a VM is the "Hard Drive" on the local machine copy for IO. Or does the VM have to read and write over the...

Greetings, I currently have a 1.12 TB CEPH fs which has 60GB of data on it that I don’t want to lose. However 1.11TB is much too large. I need to reduce it to 512GB or even 256GB. I have set the target size to 512GB however the available size of the fs refuses to move from 1.11TB. Why...

Hi everyone, I'm designing a new 3-node cluster. It's not the first cluster I make but it's the first with a full-mesh Ceph network (no dedicated switch) . Each node has a double 10G NIC and they're already physically connected each other. So I've been reading the docs and I think the best...

Hey all, I'm having trouble clearing some warnings from my ceph cluster. 1.) HEALTH_WARN: Reduced data availability: 1 pg inactive pg 1.0 is stuck inactive for 5m, current state unknown, last acting [] 2.) HEALTH_WARN: 2 slow ops, oldest one blocked for 299 sec, daemons [osd.0,osd.1] have...

I have an 8.1.4 ProxMox Ceph cluster. I'm trying to add a new host that is running the latest 8.2.2 to the cluster but when I try and add the OSD I get the failure "pveceph configuration not initialized - missing '/etc/pve/ceph'". There's a commit that went in on Feb 16, 2024 that looks like...

I have been searching far and wide for this. But I can't seem to find a solution. In one of our testing clusters we're experimenting with Ceph. But so far the journey has been bumpy at best. The actual trigger for this post is the fact that one of our VMs locked up and I can't seem to get it to...

Hey all, I have a 3 node Proxmox/ceph cluster and I decided to update. After updating the 1st node, networking no longer works on it. Others have said their 8.2.x upgrade changed the device name but that's not what I'm seeing. Upon booting up and and logging in, I can run manually run...

tenho um sistema com 3 nós e 1 OSD em cada nó. Velocidade muito lenta, principalmente escrita CrystalDiskMask ~600MBs leitura / ~30MBs escrita. Coloquei DB Disk com 2% e WAL Disk com 10% No Pool_HDD em questão, tem apenas uma VM de teste. O problema também acontece no pool_ssd. Porém tem VMs...

Hallo in die Runde! Auch wir überlegen, einen Übergang von VMWare zu Proxmox zu realisieren. Stand bisher: VMWare Cluster 5 Nodes, 2 Storages mit SAS Anbindung Nun zu unseren Überlegungen: Unter Beibehaltung der bestehenden 5 Nodes wollen wir die bestehenden Storages gegen ein Ceph-Cluster...

I have an older Proxmox node that is on 7.4.17. It is running on an older 2nd Gen i7-2960XM & is having stability issues so I don't want to upgrade it until I have everything duplicated elsewhere. I got 3 new(er) nodes running 7th gen i5 & i7s. I can't add & setup the 3rd new node until I remove...

I'm sure this has been covered before, but i wasn't able to find quite what i was looking for in other posts. i have created my proxmox 8 cluster and i have created a cephfs. cephfs needs to go to the VM's hosted within proxmox and im trying to avoid having internet traffic go outside the host...

Hi there. I have a PX cluster built on 4 nodes, they have pretty much the same hardware spec which is 2xCPU sockets, 256GB of RAM and 3 network cards: 1x 2-ports 40Gb 1x 2-ports 10Gb 1x 4-ports 1Gb 1x 2,4TB SSD hardware RAID5 1x 2TB NVMe m.2 Because some configs are difficult to change and I...

I am hoping someone can point me in the right direction on how to setup up different networks for the different traffic, including "public" and "cluster". I am new to linux / proxmox, so detailed instructions are appreciated. As of now all 5 servers are running the latest PROXMOX and they are...

Hi guys, I am trying to change Ceph networks. Since now I had one subnet (172.16.254.0/24) both for public and cluster network. The goal is to have this configuration: cluster_network = 10.10.112.0/24 public_network = 10.10.111.0/24 I have followed this tutorial...

I know there's a lot of people talking about this stuff, I just want to understand better so anyone that reads this thank you. I have a 8 node cluster with 16 OSD all 10g network, connected to the same switch, MTU 9000. I also disabled scrub. I added 4 disks to the cluster is what stared all...

Hello, I've got a 4 node PVE cluster with 3 of those nodes sharing a ceph pool. I'm running Ceph Quincy 17.2.7. I did an upgrade from Proxmox 7.4 to 8.1 and followed the steps on the 7 to 8 guide including updating to the correct repos for both PVE and Ceph. While the PVE upgrade seems to have...

hello! I have ceph nautilus external I want to use with Proxmox 8 (Ceph client Pacific ), is there anyone use this ? and Is there any error when running like that?

Hello, I would like to set up a Proxmox cluster at OVH. 3 Hosts with CEPH for HA. I was thinking of using the Advance 3 offer from OVH. I've mapped out a solution in my lab with 3 machines, each with a 1TB SSD. After configuring a 1TB CEPH datastore including the SSD for each host. Hot VM...

I was trying to install Ceph on a new 3-node Proxmox cluster. Therefore, I created two extra network bridges for my two 10G ports. The installation of Ceph was successful. However, when I wanted to configure the public and cluster networks, I encountered the following error: Multiple IPs for...