ceph

Hi community, I noticed that in the last few months, ceph is filling the /tmp partition on storage "local" more and more. Currently, there is more than 1,1T of data in there, all with ceph.XXXXXX folders containing cephfs_data subfolders. This hasn't been so "bad" before. Is that a problem with...

Indeed, Proxmox will not work when 2 out of 3 disks die in shared storage. My question is what happens when 2 disks in servers are RAID 1(shared storage) and one of the disks from two servers die? Will the Proxmox server use the raided disks or will it die?

We had an issue and removed one out of 3 disks used for HA. The system is working fine, but when we tried to add the disk back. Ceph shows drive 'in' but it is not adding it to the pool automatically for read/write. I pressed 'start' and checked the log which shows '33.333%' degraded. Used CLI...

Good afternoon. I am experiencing problems with poor ceph performance, with dd showing good results, but integration with a VM with a disk on ceph raises doubts and problems. For example, the time echo command can be executed both 00.000 ms and 02.000ms and varies in this interval, that is, it...

Hi, i'm on PVE 7.4-17 with Ceph Pacific (16.2.14). After the upgrade from 16.2.13 this warning appears. Yes i know Pacific ist EOL. Upgrade is already scheduled. Pool pool1 has 128 placement groups, should have 128 The autoscaler option for the pool is set to "warning". I have another pool...

Hi, Yesterday we started an upgrade of a cluster that was installed in 2017 and has been upgraded since. We were going to upgrade Ceph from Pacific to Quincy, and commenced by redeploying the mons, because the mons were still using leveldb, which is no longer supported in Quincy...

I am already using HA, Ceph, 10G network, and shared storage. I noticed my VMs are restarting.

Hello everyone, Im resharding my bucket, when I add number_shard 16 in queue, the process sharding is success, I check with command: radosgw-admin reshard status --bucket <bucket_id> [ { "reshard_status": "not-resharding", "new_bucket_instance_id": "", "num_shards": -1 } ] but I check...

Hi, We are using a three-node hyperconverged cluster. We are experiencing latency on only one of our nodes. On two nodes, latency varies between 1 and 5. On the last node it can be up to 300. PG autoscale is On and the Crush Rule : replicated_rule. The nodes are strictly identical: Dell...

I will preface this by saying I am a total ProxMox/CEHP noob... I am good with Linux and I have been a VMware Admin/Engineer for the better part of 2 decades... I have looked through dozens of walk-thoughts and videos but I am still struggling with CEPH and I need some help. Goal: HA...

Hello All, I need to create platform with some dockers with critical data and service , The platform i have is 3 servers with 6 x 2tb ssd and have 4x10Gbit connection each server My thought was creating hyper converged Proxmox with Ceph and create small size vm and mound the docker data on...

We have PVE running, with VMs and Containers running over NFS share to our Synology. We mostly leveraged VMs, so at the time I hadn't realized that Snapshots on NFS for containers would be an issue. Now I am starting to use LXC more often and would like to be able to have snapshots. The options...

So I have 3 servers that are all slightly different hardware if that matters. I installed them all with the same installation ISO. Run updates on each server. Joined all 3 servers to the cluster. However, server02 is facing some kind of issue. It shows as being part of the cluster (local or...

So instead of ordering 1 expensive Dell/HP server I decided to buy 2 identical more consumer grade servers. Purpose is that if one fails the other takes over. Main components: MSI MPG X670E CARBON WIFI AMD Ryzen 9 7950X3D Processor (32 threads) 192 gig DDR5 RAM Crucial MX500 250GB SSD (boot) 2...

Hi, I have deployed an HCI platform using Proxmox 8.1.3 and Ceph Reef. My deployment uses two networks for Ceph a public net 10.0.0.0/24 and cluster net 30.0.0.0/24 I have noticed something in the configuration file of ceph : [global] auth_client_required = cephx...

I was looking to see if anyone was aware with any of the modifications to the Proxmox Ceph release when compared to the upstream repository that can affect how you would get an external client to rbd volumes and cephfs pools. I recently built up a test cluster of all pve 8.1.3 (3 machines, 1 SSD...

Is there a way to recover data from OSDs if the monitors and managers don't work anymore but the OSDs still start up? Just for clarification: I don't want to rebuild the cluster I just want to copy data from the OSDs to another HDD.

Hello, we recently got new Servers for our organization and havent really had experience with Proxmox before. We migrated everything from VMWare to Proxmox. Worked really well. Now we are facing the problem that we dont have Node failover since our Pool min_size is 2. A little bit about our...

Hello, Today I added another node to the cluster. Before attaching it, I installed ceph. Ceph is version 17.2.6, while on the other nodes it is version 17.2.5. On the new server, I can't enable ceph monitor, even though when I try to do so, I get a response that everything is ok. The message...

recently i upgraded the server to proxmox version 8.1x from 7.x, and found this error message in syslog, kindly advise if this is some kind of error during upgrade ? 2023-12-07T18:35:26.242453+05:30 pve-3 ceph-crash[2036]: 2023-12-07T18:35:26.236+0530 7f83573ff6c0 -1 auth: unable to find a...