ceph

I have an older Proxmox node that is on 7.4.17. It is running on an older 2nd Gen i7-2960XM & is having stability issues so I don't want to upgrade it until I have everything duplicated elsewhere. I got 3 new(er) nodes running 7th gen i5 & i7s. I can't add & setup the 3rd new node until I remove...

I'm sure this has been covered before, but i wasn't able to find quite what i was looking for in other posts. i have created my proxmox 8 cluster and i have created a cephfs. cephfs needs to go to the VM's hosted within proxmox and im trying to avoid having internet traffic go outside the host...

Hi there. I have a PX cluster built on 4 nodes, they have pretty much the same hardware spec which is 2xCPU sockets, 256GB of RAM and 3 network cards: 1x 2-ports 40Gb 1x 2-ports 10Gb 1x 4-ports 1Gb 1x 2,4TB SSD hardware RAID5 1x 2TB NVMe m.2 Because some configs are difficult to change and I...

I am hoping someone can point me in the right direction on how to setup up different networks for the different traffic, including "public" and "cluster". I am new to linux / proxmox, so detailed instructions are appreciated. As of now all 5 servers are running the latest PROXMOX and they are...

Hi guys, I am trying to change Ceph networks. Since now I had one subnet (172.16.254.0/24) both for public and cluster network. The goal is to have this configuration: cluster_network = 10.10.112.0/24 public_network = 10.10.111.0/24 I have followed this tutorial...

I know there's a lot of people talking about this stuff, I just want to understand better so anyone that reads this thank you. I have a 8 node cluster with 16 OSD all 10g network, connected to the same switch, MTU 9000. I also disabled scrub. I added 4 disks to the cluster is what stared all...

Hello, I've got a 4 node PVE cluster with 3 of those nodes sharing a ceph pool. I'm running Ceph Quincy 17.2.7. I did an upgrade from Proxmox 7.4 to 8.1 and followed the steps on the 7 to 8 guide including updating to the correct repos for both PVE and Ceph. While the PVE upgrade seems to have...

hello! I have ceph nautilus external I want to use with Proxmox 8 (Ceph client Pacific ), is there anyone use this ? and Is there any error when running like that?

Hello, I would like to set up a Proxmox cluster at OVH. 3 Hosts with CEPH for HA. I was thinking of using the Advance 3 offer from OVH. I've mapped out a solution in my lab with 3 machines, each with a 1TB SSD. After configuring a 1TB CEPH datastore including the SSD for each host. Hot VM...

I was trying to install Ceph on a new 3-node Proxmox cluster. Therefore, I created two extra network bridges for my two 10G ports. The installation of Ceph was successful. However, when I wanted to configure the public and cluster networks, I encountered the following error: Multiple IPs for...

Hello, I'm managing a cluster of 4 nodes using proxmox 7.4-17 with CEPH. After a messy shutdown caused by a long power outage, a couple of VM images were corrupted, but we could restore them from backup. However, two of the OSD services refuse to come back, showing this kind of error: Apr 18...

I have set up a Proxmox 8 ceph cluster with an EC pool called tsPool1. Now I want to connect an independent standalone proxmox 8 host to that cluster using rbd. I used the GUI Datacenter->Storage-> Add feature to setup the storage. The storage is created but I only get a connect when I use...

Hi, i must restore an old 3 node cluster. Which dirs do i have to backup for the cluster restores exactly like was before (configuration, files...). Which is the correct procedure to recover it? Thank you

I have an existing ProxMox Ceph cluster with ceph v18.2.1. I want to add a new host to the cluster but the ceph version it installs is 18.2.2 so I get warnings about a mismatch. How do I install the 18.2.1 version on my new host? The command I'm using is: pveceph install --repository...

Proxmox noob here - I've been asked to setup a 3 node PVE 8.1.10 cluster specifically to investigate options for monitoring with our NMS. First install, I hit the (apparently) well known CEPH v18.2 (Reef) dashboard compatibility problem, and subsequently rebuilt the cluster and installed CEPH...

We'd been having issues with a particular (Synology) Hyper Backup quite some time. Synology support analyzed the log files and told us that there's no ETag returned after a multi-part upload: 2023-11-21T13:20:55+01:00 NAS img_worker[20149]: (20149) [err] transfer_s3.cpp:355 ETag is empty...

Hi, Long shot.... Trying to repair the questionable decision to reinstall for upgrade from 7.4.x and to 8.1.4. Question: Why is the iperf3 showing these issues? Not necessarily even a problem, but still very strange results. Background: 4 host machines 256 core in total 2TB RAM, all...

Doing this all on the command line to create a VM on a Ceph storage. Hoping this is a simple fix. qm create ... qemu-img create rbd:Ceph/vm-998-disk-0 41G Formatting 'rbd:Ceph/vm-998-disk-0', fmt=raw size=44023414784 When I run the following command, I get this error: # qm disk import 998...

I have a three node cluster. Each node is an HP 600 G6 DM with the built in 1GbE port and a 10GbE add on through the Flex IO port. Each nodes gigabit port is connected to my UniFi Dream Machine on the 10.0.2.0/24 (VLAN2) network. The three 10GbE connections are connected to a USW-Flex-XG. I plan...

So I have some servers where I am trying to setup the ssd to utilize erasure-coding. Problem is there are hdd's on as well and I needed to set the device class to ssd.. So using the instructions I was able to create the profile I wanted using the following command ceph osd erasure-code-profile...