ceph

Any guess for Ceph 19.2 implementation on the horizon?

Hi, i get the error message "595 Connection refused" if i try to manage 2 of a 4 nodes cluster. This is a production cluster and every node comes with 1 dedacted 10gig nic which one with 2 ports, one for HA and one for Ceph. The manage network is on default 1gig nic, checking on logs i'll see...

Hi yall, I'm thinking about creating a Ceph pool with a EC 2+4 scheme. Even though I did intensive Google reserch, I could not find any experience with that. My idea is this: The Ceph cluster is spread across two fault domains (latency < 1 ms, 40 disks on each side, all NVME SSDs, lots of CPU...

We have two data centers (streched cluster) with 4 servers each in a VMware vsan config ( with Raid 1 -mirroring) of each with 20 disks / 60TB total capacity ( RAW). We would like to convert this cluster into proxmox with ceph as a storage. I am listing out only the current VSAN storage layout...

Hi, We want to procure a 3-node Proxmox cluster with Ceph. The configuration of each node would be as follows: Memory: 384GB CPU: 40 core (80 Thread) OS: 2 enterprise SSD drives in RAID1 mode Ceph OSD: 5 x enterprise mixed used NVMe SSD drives. (All will be connected to the On-board storage...

Hello, I have 4 Proxmox nodes with 2x10G interfaces. I am testing out a configuration without a switch. I have followed the tutorial in the https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server The only difference between my setup and the setup in the tutorial is the addition of the...

According to the Ceph docs, if a pool has less than min_size OSDs available, IO is blocked, that includes writes, but also reads. This seems counter-intuitive to me, does anyone know, why this is the case? Examples: Standard 3/2 pool, replicated with size 3, min_size 2: Can fully read and...

Hi, I have a test cluster of 3 nodes, each with 2 disks : one for boot + Proxmox, the other for storage. But I want to add a shared storage to make some tests. Before going to a NAS with iSCSI, I want to try something new (for me) : CEPH So, is it possible to dedicate the storage disk of each...

I've been messing with Proxmox on and off for years in homelab using old desktops as hosts and lately added a pair of second-hand enterprise servers. Just started messing with Ceph in virtualized hosts, had a lot of fun with that and I want to try running it on metal for home & lab use. However...

Hello I have just configured ceph on proxmox and i see that the monitor on the 2nd node and 3rd node is stopped state I am running a 3-node cluster the systemctl is showing active and running but for some reason it's in a stopped state in GUI I just found this on Syslog in the uI ep 25 21:59:08...

We're putting ProxMox VE through it's paces, and testing everything we can. we have an external ceph cluster that is working well, machines are running nicely (if slowly because it's all 7200 RPM spinning rust at this point) My question is - can the ProxMox ceph gui manage this external ceph...

Good day all, I have a three node proxmox cluster running ceph and i have created two pools. The first pool (vmpool) consisted from NVME drives for my VMs which ceph assigned 128pgs The second pool (datapool) consisted from HDD drives for my VMs which ceph assigned 32pgs Please see attached...

Hi all, I am trying to build a local 3 node Proxmox cluster with Ceph for HA These would be the 3 server nodes MBO: ASUS ProArt B650-CREATOR CPU: AMD Ryzen 9 7900 MEM: 128GB DDR5 PVE SSD: 2 x Micron 7400 PRO M.2 1.92TB on MBO Ceph storage: 4 x Micron 7400 PRO M.2 1.92TB on ASUS Hyper M.2...

Hi there, We have a cluster that has 4 nodes with Ceph storage. One of those nodes died yesterday, which puts the cluster in danger of freezing if another node goes down. I'm working on getting the dead node repaired and back online, but it will take a few weeks to get parts for it and get it...

Hi. I'm been playing around with Ceph using cephadm and would like to explore Proxmox for our "management" cluster for our upcoming Apache CloudStack project. I noticed that Proxmox did have integration with Ceph but not using cephadm as the ochestrator. My question is, is it possible to have...

Hi, thank you for accepting me into this community. I have set up a new cluster for production (my first non vSPhere cluster) and I am running into a little problem. Given that we have a 4 node cluster I wanted to add additional quorum following the Instructions from the manual...

I have three nodes in my cluster, each as a ceph mon, mgr, and two mds each. My problem comes when I try to mount on boot. I think the issue is with my /etc/fstab, as pasted below. I tried using the Proxmox storage but it was very inconsistent while fstab works much better. This setup works to...

I've been wrestling with this issue for over a month now, and I cant seem to get past it. I have two pgs that havent been scrubbed since June: $ ceph health detail | grep "not scrubbed since 2024-06" pg 17.3dc not scrubbed since 2024-06-01T20:46:29.042727-0700 pg 17.137 not scrubbed...

Hello, I've seen this happen a few times now and it's always right when PBS goes to do backups on the node. The node keeps logging but drops from the cluster and shows offline. Here are the logs: And then for the rest of the night it just logs these timeouts: Not sure what logs to pull to...

Hi, May I know if anyone did follow this documentation? and will this work? Also, is recommended? will affect proxmox function? https://pve.proxmox.com/wiki/User:Grin/Ceph_Object_Gateway Thank you.