ceph

Hello guys, I have a server that is now set as: 2 disk Mirror with zfs (SSD). for boot and 4 disk for ceph. I have an option to install nvme so my plan was to do the following: brake the mirror, use the nvme as mirror and then use the SSD drive to enlarge the ceph pool. Any suggestions on that...

Hi, I plan to set up a 2-node cluster, with each node having exactly the same configuration: 1 CPU with 12 cores, 64 GB RAM, 5 x GbE, 2 TB NVMe SSD, and 500 GB SATA-6 SSD. Network: One GbE will be dedicated to Proxmox Virtual Environment (PVE) administration (on a dedicated VLAN) and...

Hi, to set the context, I want to connect my ceph cluster to my proxmox cluster, I did the same thing as leihnix Post reference: the https://forum.proxmox.com/threads/using-external-ceph-cluster.93453/ I also see that my pool is visible with a question mark but the size is not available, do you...

Hello all, i just noticed, that one of my Cluster Nodes shows following log every 1-2 minutes: FYI: The Cluster works and Ceph is showing all OK Feb 08 01:18:52 pve-2 pvedaemon[3570]: <root@pam> successful auth for user 'monitoring@pve' Feb 08 01:18:54 pve-2 ceph-crash[2062]...

Hello, I have 3 identical servers running identical version of Proxmox with all of therm fully upgraded. Each has 2 network cards installed, one is on-board quad 10gb and another is PCie quad port SPF+ 10gb. I have created two bridges, each bridge having all 4 ports assigned. Both bridges has...

Hello, to set the context, I have a proxmox cluster with 3 nodes, I also have a ceph cluster with 3 nodes, everything is fine and everything works well independently. But, before linking the ceph cluster and the proxmox cluster (CephFS), I want a linux/windows client to use the ceph cluster as...

Hello, I have 3 servers later planning to add 3 nodes more. Lenovo sr570 CPU: 2x Xeon Silver 4208 2.1ghz 8c 16t OS: 2x sata 480gb m.2 ssd mirroring kit Network: 4x10GBase-T 2x lacp for frontend and cluster and 2x Lacp for ceph cluster and public every where will be individual Vlan. Switch: 2x...

Just written down for your amusement, on a lazy, dark and rainy Sunday afternoon: Someone (me) might try to extend a Ceph cluster by adding NVMe (or other SSDs) via USB3 Adapters. For a small homelab this should be feasable, isn't it? My three PVE nodes already run a single Ceph OSD on an...

Hi, I have a probleme with my proxmox cluster, I have a bond for CEPH derectly connected betwen the nodes in 10Gb and a bond for public network with 10Gb link to. But when i do an iperf with public network I have my 10Gb/s but not with my CEPH network. Before this configuration I haved...

For my testing/development environment, I am looking to configure a cluster of Proxmox servers using a Ceph storage pool so I can implement HA. My goals are high availability and having the ability to bring down a host for maintenance and patching. Also, to handle the occasional fault. I...

Hey everyone, I am running my kubernetes nodes on my Dell R730 At the moment they are using a bridged Network on a 10Gbe NIC…But I only have a 1Gbe switch.\ That said, the server has a second (unused 10Gbe Nic) eno2 I was wondering if It would be possible to create a “logical” inter-vm network...

Is it possible to configure two Network interfaces as a BOND to be on the same Network? I imagine it's better for performance & HA vs using only one interafce for each net. also.. Can I create disks which are bigger than one physical Disk when using ceph? like a VM which has a disk of 3TB if I...

I am putting together a 3x node cluster for my own education (before doing this for real at work!) and I have the following plan for subnets for the cluster. This setup is based on all the tutorials I've been able to find online, but I wanted to make sure I'm doing this right. I have enough...

I have 3 servers in the cluster, each server has- 1. 2 HDD hard drive and hardware Raid 1 for local storage and os storage 2. 1 SSD for Ceph use for HA. I have 2 VMs in local-lvm(ext4) and 2 in Ceph storage. My Ceph HA is working fine, it only fails when 2 out of 3 servers die. However I...

Hi community, I noticed that in the last few months, ceph is filling the /tmp partition on storage "local" more and more. Currently, there is more than 1,1T of data in there, all with ceph.XXXXXX folders containing cephfs_data subfolders. This hasn't been so "bad" before. Is that a problem with...

Indeed, Proxmox will not work when 2 out of 3 disks die in shared storage. My question is what happens when 2 disks in servers are RAID 1(shared storage) and one of the disks from two servers die? Will the Proxmox server use the raided disks or will it die?

We had an issue and removed one out of 3 disks used for HA. The system is working fine, but when we tried to add the disk back. Ceph shows drive 'in' but it is not adding it to the pool automatically for read/write. I pressed 'start' and checked the log which shows '33.333%' degraded. Used CLI...

Good afternoon. I am experiencing problems with poor ceph performance, with dd showing good results, but integration with a VM with a disk on ceph raises doubts and problems. For example, the time echo command can be executed both 00.000 ms and 02.000ms and varies in this interval, that is, it...

Hi, i'm on PVE 7.4-17 with Ceph Pacific (16.2.14). After the upgrade from 16.2.13 this warning appears. Yes i know Pacific ist EOL. Upgrade is already scheduled. Pool pool1 has 128 placement groups, should have 128 The autoscaler option for the pool is set to "warning". I have another pool...

Hi, Yesterday we started an upgrade of a cluster that was installed in 2017 and has been upgraded since. We were going to upgrade Ceph from Pacific to Quincy, and commenced by redeploying the mons, because the mons were still using leveldb, which is no longer supported in Quincy...