ceph

I am hoping someone can point me in the right direction on how to setup up different networks for the different traffic, including "public" and "cluster". I am new to linux / proxmox, so detailed instructions are appreciated. As of now all 5 servers are running the latest PROXMOX and they are...

Hi guys, I am trying to change Ceph networks. Since now I had one subnet (172.16.254.0/24) both for public and cluster network. The goal is to have this configuration: cluster_network = 10.10.112.0/24 public_network = 10.10.111.0/24 I have followed this tutorial...

I know there's a lot of people talking about this stuff, I just want to understand better so anyone that reads this thank you. I have a 8 node cluster with 16 OSD all 10g network, connected to the same switch, MTU 9000. I also disabled scrub. I added 4 disks to the cluster is what stared all...

Hello, I've got a 4 node PVE cluster with 3 of those nodes sharing a ceph pool. I'm running Ceph Quincy 17.2.7. I did an upgrade from Proxmox 7.4 to 8.1 and followed the steps on the 7 to 8 guide including updating to the correct repos for both PVE and Ceph. While the PVE upgrade seems to have...

hello! I have ceph nautilus external I want to use with Proxmox 8 (Ceph client Pacific ), is there anyone use this ? and Is there any error when running like that?

Hello, I would like to set up a Proxmox cluster at OVH. 3 Hosts with CEPH for HA. I was thinking of using the Advance 3 offer from OVH. I've mapped out a solution in my lab with 3 machines, each with a 1TB SSD. After configuring a 1TB CEPH datastore including the SSD for each host. Hot VM...

I was trying to install Ceph on a new 3-node Proxmox cluster. Therefore, I created two extra network bridges for my two 10G ports. The installation of Ceph was successful. However, when I wanted to configure the public and cluster networks, I encountered the following error: Multiple IPs for...

Hello, I'm managing a cluster of 4 nodes using proxmox 7.4-17 with CEPH. After a messy shutdown caused by a long power outage, a couple of VM images were corrupted, but we could restore them from backup. However, two of the OSD services refuse to come back, showing this kind of error: Apr 18...

I have set up a Proxmox 8 ceph cluster with an EC pool called tsPool1. Now I want to connect an independent standalone proxmox 8 host to that cluster using rbd. I used the GUI Datacenter->Storage-> Add feature to setup the storage. The storage is created but I only get a connect when I use...

Hi, i must restore an old 3 node cluster. Which dirs do i have to backup for the cluster restores exactly like was before (configuration, files...). Which is the correct procedure to recover it? Thank you

I have an existing ProxMox Ceph cluster with ceph v18.2.1. I want to add a new host to the cluster but the ceph version it installs is 18.2.2 so I get warnings about a mismatch. How do I install the 18.2.1 version on my new host? The command I'm using is: pveceph install --repository...

Proxmox noob here - I've been asked to setup a 3 node PVE 8.1.10 cluster specifically to investigate options for monitoring with our NMS. First install, I hit the (apparently) well known CEPH v18.2 (Reef) dashboard compatibility problem, and subsequently rebuilt the cluster and installed CEPH...

We'd been having issues with a particular (Synology) Hyper Backup quite some time. Synology support analyzed the log files and told us that there's no ETag returned after a multi-part upload: 2023-11-21T13:20:55+01:00 NAS img_worker[20149]: (20149) [err] transfer_s3.cpp:355 ETag is empty...

Hi, Long shot.... Trying to repair the questionable decision to reinstall for upgrade from 7.4.x and to 8.1.4. Question: Why is the iperf3 showing these issues? Not necessarily even a problem, but still very strange results. Background: 4 host machines 256 core in total 2TB RAM, all...

Doing this all on the command line to create a VM on a Ceph storage. Hoping this is a simple fix. qm create ... qemu-img create rbd:Ceph/vm-998-disk-0 41G Formatting 'rbd:Ceph/vm-998-disk-0', fmt=raw size=44023414784 When I run the following command, I get this error: # qm disk import 998...

I have a three node cluster. Each node is an HP 600 G6 DM with the built in 1GbE port and a 10GbE add on through the Flex IO port. Each nodes gigabit port is connected to my UniFi Dream Machine on the 10.0.2.0/24 (VLAN2) network. The three 10GbE connections are connected to a USW-Flex-XG. I plan...

So I have some servers where I am trying to setup the ssd to utilize erasure-coding. Problem is there are hdd's on as well and I needed to set the device class to ssd.. So using the instructions I was able to create the profile I wanted using the following command ceph osd erasure-code-profile...

Hello ! I am receiving a lot of email about Offline_Uncorrectable in my SSD, in different servers and multiple devices. The following warning/error was logged by the smartd daemon: Device: /dev/sdc [SAT], 16 Offline uncorrectable sectors Device info: HFS1T9G32FEH-BA10A...

Hello everyone We have gotten this failure on our 3 nodes cluster and I really don't know how to solve it. I would really appreciate the help. Thanks in advance

Long story short... not possible. I'm planning to install and use ceph and HA in my working cluster enviroment. I have 4 nodes with 256GB RAM each and 2x10G NICs dedicated for ceph cluster network traffic. I already know this may be not enough for perfect performance so I'm planning to swap NICs...