ceph

  1. F

    Ceph Monitors not starting

    Hello I have just configured ceph on proxmox and i see that the monitor on the 2nd node and 3rd node is stopped state I am running a 3-node cluster the systemctl is showing active and running but for some reason it's in a stopped state in GUI I just found this on Syslog in the uI ep 25 21:59:08...
  2. B

    Using external CEPH

    We're putting ProxMox VE through it's paces, and testing everything we can. we have an external ceph cluster that is working well, machines are running nicely (if slowly because it's all 7200 RPM spinning rust at this point) My question is - can the ProxMox ceph gui manage this external ceph...
  3. F

    is this a correct number of pg placement in datapool ?

    Good day all, I have a three node proxmox cluster running ceph and i have created two pools. The first pool (vmpool) consisted from NVME drives for my VMs which ceph assigned 128pgs The second pool (datapool) consisted from HDD drives for my VMs which ceph assigned 32pgs Please see attached...
  4. E

    Proxmox 3 node cluster HW suggestion

    Hi all, I am trying to build a local 3 node Proxmox cluster with Ceph for HA These would be the 3 server nodes MBO: ASUS ProArt B650-CREATOR CPU: AMD Ryzen 9 7900 MEM: 128GB DDR5 PVE SSD: 2 x Micron 7400 PRO M.2 1.92TB on MBO Ceph storage: 4 x Micron 7400 PRO M.2 1.92TB on ASUS Hyper M.2...
  5. T

    Adding a node to a cluster with Ceph storage

    Hi there, We have a cluster that has 4 nodes with Ceph storage. One of those nodes died yesterday, which puts the cluster in danger of freezing if another node goes down. I'm working on getting the dead node repaired and back online, but it will take a few weeks to get parts for it and get it...
  6. H

    Proxmox VE Ceph with separate Ceph OSD servers

    Hi. I'm been playing around with Ceph using cephadm and would like to explore Proxmox for our "management" cluster for our upcoming Apache CloudStack project. I noticed that Proxmox did have integration with Ceph but not using cephadm as the ochestrator. My question is, is it possible to have...
  7. G

    Adding Corosync External Vote Support

    Hi, thank you for accepting me into this community. I have set up a new cluster for production (my first non vSPhere cluster) and I am running into a little problem. Given that we have a 4 node cluster I wanted to add additional quorum following the Instructions from the manual...
  8. R

    Inconsistent ceph automounting between nodes

    I have three nodes in my cluster, each as a ceph mon, mgr, and two mds each. My problem comes when I try to mount on boot. I think the issue is with my /etc/fstab, as pasted below. I tried using the Proxmox storage but it was very inconsistent while fstab works much better. This setup works to...
  9. A

    ceph pgs not scrubbing for a long time

    I've been wrestling with this issue for over a month now, and I cant seem to get past it. I have two pgs that havent been scrubbed since June: $ ceph health detail | grep "not scrubbed since 2024-06" pg 17.3dc not scrubbed since 2024-06-01T20:46:29.042727-0700 pg 17.137 not scrubbed...
  10. M

    Node Drops from Cluster When PBS Kicks In

    Hello, I've seen this happen a few times now and it's always right when PBS goes to do backups on the node. The node keeps logging but drops from the cluster and shows offline. Here are the logs: And then for the rest of the night it just logs these timeouts: Not sure what logs to pull to...
  11. powersupport

    create s3 capabilities in proxmox

    Hi, May I know if anyone did follow this documentation? and will this work? Also, is recommended? will affect proxmox function? https://pve.proxmox.com/wiki/User:Grin/Ceph_Object_Gateway Thank you.
  12. F

    Best Utilization for network ports

    I am building out a 3 node cluster for home lab use. Each node has (2) 2.5 gb nics which currently plug into 1 gb ports on my switch, (2) SFP+ ports, and (2) 40 gb ports. I currently have the 40 gb configured in a mesh network. I would like to separate everything out to avoid network...
  13. I

    I get it. I get it. 3 Nodes for Ceph. But what about ZFS shared?

    I have a pretty basic need, for a small business I own. Basically one VM that I need to run, and in essence I want HA, in the sense that if the node fails, it's taken over by another proxmox server. I'd prefer it to used shared storage ZFS, and I have this running in lab right now. I've stayed...
  14. D

    Upgrade from version 7.4-3 to 8.2-4 issues.

    Hello everyone, During the migration of one of my Proxmox nodes from version 7.4-3 to version 8.2-4, when booting with the kernel 6.8.12-1 that comes with this latest version, the following error appears: libceph: mon1 (1) 192.168.169.20:6789 socket closed ((con state V1_BANNER)) libceph: mon5...
  15. A

    VM migration during ceph remapping

    Hello! I wanted to ask a quick question because i'm not totally sure at the moment and don't want to risk any of my VMs. I was forced to replace a node in my cluster urgently which worked perfectly fine. My ceph is currently in the state of remapping+refilling because of the newly added OSDs...
  16. A

    Does the Dell HBA465i controller work to set up a CEPH OSD

    With a view to buying a Dell server with a Boss-n1 card in raid one for the system part (Proxmox. I don't think there is a problem on that side), I would like to know if the HBA465i backplane that Dell offers me in its quote, will allow me to see the SSD disks under Proxmox to set up a CEPH OSD
  17. M

    link: host: 3 link: 0 is down

    I was looking for many other similar questions but could not find any exact answers. In my case I have three server's ha network on 65 subnets and they are connected to one another using 10GB wire and ports. 1 VM is running on each node and is part of a cluster. I tried to tune my pacemaker...
  18. K

    [8.2.4] [bug] service ceph-mon is not working properly

    tl:dr changing %i to corresponding name make service mon working. One of my mons keeps dying, restarting and cannot start again, so I investigate it. It cannot start due to misconfiguration in /etc/systemd/system/ceph-mon.target.wants/ceph-mon@pve2.service file at "%i" variable, which points to...
  19. K

    Windows server 2022 poor random read and write performance

    Hello, I am looking for a way to improve the performance of random reads and writes on a virtual machine with windows server 2022. VM configuration: agent: 1 boot: order=virtio0;ide2;net0;ide0 cores: 6 cpu: qemu64 machine: pc-i440fx-9.0 memory: 16384 meta: creation-qemu=9.0.0,ctime=1724249118...
  20. D

    Limited hardware Proxmox setup. Need advice.

    Hello, I have a handful of baremetal servers that I would like to migrate to proxmox vms. As I move the data off the servers, I can reuse hardware to add to the proxmox cluster. Each server is currently configured in a raid 5 with 20 ish Terabytes available. All storage is using HDDs and there...