ceph

  1. R

    Dell VxRail converted to ProxMox+Ceph?

    Hi has anyone taken a Dell VxRail (VMware and vSAN) and wiped it, and reprovisioned it as ProxMox with Ceph? we have a couple of clusters, with Dell servers connected together via Dell 10Gb/100Gb switches - can these be reused or are they restricted in their BIOS etc? just working out if we...
  2. D

    Ceph Database Deployment Geo-distribution & Latency Question

    I love Proxmox's ability to make it super easy to set up a three-node HA cluster with Ceph. I like to use it for my VMs and SQL databases that require a lot of IOPS. This way, if one of the nodes goes down, my SQL DB VM can be quickly redeployed to another node. That way, if one of the nodes...
  3. K

    Using PBS as 4th Ceph node in 3-node Proxmox cluster

    Good afternoon. In my homelab I want to make a 3-node Proxmox cluster with Ceph. I also want to add a 4th separate host with PBS for backups. Each node in the Proxmox cluster will have an SSD for a 3/2 replicated Ceph pool for VM/CT disks. I also want to add a spinning HDD to each node for...
  4. G

    Need advise for first serious proxmox ceph evaluation lab

    Proxmox Lab Setup - need advise Some old R730 are hanging around in our office and I would like to make a proxmox ceph cluster lab built under production conditions. I have following at disposal: 4x R730 8 core Xeon 96GB DDR4 each with 8 SFF slots for disks HBA330 sas controller 6x 480GB...
  5. F

    New cluster build, taking suggestions and recommendations

    Building a three (3) node cluster. Each node is: Dell R620 Dual E5-2690 v2 @ 3.00GHz 768GB ECC RAM 2x 10Gb Ethernet 2x 1Gb Ethernet Dell H310 flashed to IT Mode - 8x Crucial MX500 4TB SSD 3x StarTech Dual M.2 PCIe SSD Adapter Card - 6x Crucial P3 4TB NVME SSD 2x SanDisk 128GB USB SSD -...
  6. powersupport

    ceph unexpected rebalancing

    Hi, Today, I removed a snapshot from a VM (2TB storage )in the Proxmox cluster. Shortly afterward, Ceph started rebalancing, causing all VMs to go down until I halted the removal process and the rebalancing was completed. What might have caused this issue?
  7. powersupport

    ceph wanring pgs not deep-scrubbed in time

    We’ve been receiving warnings about 621 PGs not being deep-scrubbed and 621 PGs not being scrubbed in time for a while now, and the issue doesn't seem to be resolving. Is there a command that can address this problem? There are over 600 PGs showing this error—will manually scrubbing each PG...
  8. F

    3 nodes Ceph config with public ip

    Hey Everyone i have a 3 node cluster with proxmox 8.2.2 they have public IP assigned three servers in three different locations my problem is I have installed ceph but the public IP on each of the server is different and has different network how do I resolve this and create a the ceph cluster...
  9. F

    Netzwerk Konfiguration mit Ceph

    Hallo, wir setzen gerade einen neuen Proxmoxcluster auf. Hier suche ich nach einem guten Ansatz für das Netzwerk. Hardware: 5 x Dell Server (Proxmox) - mit je 7,68TB ssd für ceph - 2 x 1GB - 4 10GB - 2 100GB 1 x Dell Server (Backupserver)...
  10. J

    Cephfs mounting issues

    I am running into some issues mounting a Cephfs on a VM using FStab. i have another Vm with the same config that works just fine, but the 2nd VM mounting the same FS has issues mounting with fstab. i made sure i followed the pre-requisites for mounting a cephfs, i authorized the user (wing1)...
  11. E

    Ceph With 2 nodes with OSD and 1 node only for quorum

    Hi, It's not really a Proxmox question, but on the Ceph support available on proxmox. I know that it's not the ideal, but's it's a question : I have 3 servers : - server A : Proxmox with Ceph : this server has OSD - server B : Proxmox with Ceph : this server has OSD - server C : Proxmox with...
  12. D

    CEPH deployment went hiwired using wizzard

    Hello, 3 nodes, identical, new installation from latest ISO, upgraded all nodes, added ceph reef sources. I installed ceph on all 3 hosts individually. It came online, green initiall (well also now it is green), but only on node 1 the manager is running and it is green, node 2 and 3 are in...
  13. V

    [SOLVED] ceph cluster rebuild - Import bluestore OSDs from old cluster (bad fsid) - OSD dont start. He only stays in down state

    ceph version 18.2.2 (e9fe820e7fffd1b7cde143a9f77653b73fcec748) reef (stable) Hello everyone, please we need your help to import the bluestore OSDs to the new cluster, because after trying to import, we noticed that the OSDs do not start. They are only in a "down" state and are imported as...
  14. A

    My Ceph mon on one node fail and won't start

    I have A ceph on 3 node working for a year. I get a HEALTH_WARN about : 2 OSD have spurious read erros 1/3 mons down, quorum ceph01,ceph03 I tried to start mon on ceph02. But not working. xxxxxxx@ceph02:~# systemctl status ceph-mon@ceph02 ● ceph-mon@ceph02.service - Ceph...
  15. B

    ISOs uploaded to PVE via GUI became corrupted on cephfs. . .

    We uploaded two ISOs on June 11 via the proxmox GUI and made use of the checksum matching feature while doing so. root@pve1:/var/log/pve/tasks# pvenode task list --type imgcopy...
  16. M

    Having problem while setting up ceph dashboard in the latest proxmox ve version

    so i cant attach the screenshots for some reason so ill just copy paste it over here -First issue root@CIS-Node6:\~# ceph dashboard create-self-signed-cert no valid command found; 10 closest matches: pg stat pg getmap pg dump...
  17. E

    [SOLVED] Cloning images to Ceph pool fails after updates

    I have a cluster of 3 PVE nodes with a Ceph pool hosted between them for VM and container disk images. I recently updated from PVE 7 to 8 and Ceph Pacific to Reef. Specifically, I did the following: Update PVE to the latest v7 Update Ceph from Pacific to Quincy as per the wiki instructions...
  18. E

    Node Stuck on GUI Cant Remove

    hey all! I was trying to add another box to my clusters but I messed up the addressing and caused it to fail but now i cant remove it. Is this something that can be manually removed? Thank you !
  19. A

    Hardware for Proxmox Cluster with CEPH Storage

    Dears, I'm preparing to buy 3 Dell servers for our Proxmox Cluster. I am planning to use CEPH storage for the Cluster. I would like to know whether CEPH storage can work with a RAID controller, but the disks for CEPH will be configured in NON-RAID mode. I want to use RAID controller because I...
  20. S

    [SOLVED] rbd mirror - cannot setup peer on site-a

    Hello, I would be very grateful for some help, I have been trying to setup an rbd mirror on a pool between two proxmox ceph clusters. I have followed the instructions here : https://pve.proxmox.com/wiki/Ceph_RBD_Mirroring And also here : https://satishdotpatel.github.io/ceph-rbd-mirroring/...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!