ceph

Long story short... not possible. I'm planning to install and use ceph and HA in my working cluster enviroment. I have 4 nodes with 256GB RAM each and 2x10G NICs dedicated for ceph cluster network traffic. I already know this may be not enough for perfect performance so I'm planning to swap NICs...

I need to create a new VM (250+ actually) that uses Ceph storage. To create a disk on non-Ceph storage: echo "----- Creating the disk -----" qemu-img create -f qcow2 $DISK $STORAGE_SIZE How do I create a disk on Ceph storage?

Hello, I'm excited to share that I've successfully migrated and imported two virtual machines from an existing KVM ovirt environment to a new hyperconverged Proxmox setup, utilizing an external Ceph cluster, which also operates as a KVM environment. Leveraging the Proxmox migration guidelines...

Hello, I have a system landscape where I have set up a ProxmoxVE instance and an external Ceph cluster in Quorum 3. From there, I migrated two VMs, along with their disks, from an already existing oVirt KVM landscape to ProxmoxVE for testing purposes, using the CLI utilities provided by...

Hello! We have recently installed a PVE cluster with three nodes and want to use Cephs. The hosts are (almost) identical. Host 3 has a different network interface. We have a public network channel and an exclusive cluster network channel for Ceph. Each host has four discs for OSDs. Creating...

Greetings community! After few month of using ceph from Proxmox i decided to add new disk and stuck with this issue. ceph version 17.2.7 (2dd3854d5b35a35486e86e2616727168e244f470) quincy (stable) Running command: /usr/bin/ceph-authtool --gen-print-key Running command: /usr/bin/ceph --cluster...

Hi everyone, long time lurker but hey, there's a first time at anything right? So i have posted about a problem i'm facing on the proxmox reddit, and someone PM'd me to post it also here, so here's a copypasta of the original post with added all the things they told me to try over there, hope...

root@pve1:~# sudo cat /etc/ceph/ceph.conf [global] auth_client_required = cephx auth_cluster_required = cephx auth_service_required = cephx cluster_network = 192.168.65.10/24 fsid = 5dcbd126-d511-4e12-a653-fee67d7ec467 mon_allow_pool_delete =...

Hi, I read this sentence on ceph hardware-recommendations : "Provision at least 10 Gb/s networking in your datacenter, both among Ceph hosts and between clients and your Ceph cluster" This is my ceph configuration: [global] auth_client_required = cephx auth_cluster_required = cephx...

It will help if it is GUI-based steps to create CephFS. I currently have configured Ceph as shared storage on all 3 nodes. Also, Linux VMs are on local storage. I have to use CephFs to create a shared folder between 2 VMs on different nodes.

OK, so I’m fairly new to Proxmox and Ceph. I need some advice on how to migrate to Ceph. Current Layout: SERVER01: (Same exact hardware as SERVER02) Production - hosting 20-30 VM’s Storage Hardware RAID 2 - SSD’s setup as RAID1 6 - SSD’s setup as RAID5 This storage is hosting the VM’s Needs...

Storage noob here. I am building a new single node proxmox server on a 2U server that has 9 3.5in 4TB HDDs and 6 2.5in 800GB SSDs beyond what is used for Proxmox's boot image. The server will be running a mix of stateful container workloads, databases for stateless containers, and VMs for...

Hi, I'm building a cluster with Proxmox mainly for running LXC CTs. I have 5 identical servers all connected through a 40Gbps switch. I also want to use the same servers for Ceph so they can share their local disks with each other. In PVE Ceph wiki page it recommends 3 NICs for a high...

Please help me with your advice. I need to implement fault tolerance at the datacenter level in the Proxmox VE hyperconverged cluster (pve-manager/8.1.4/ec5affc9e41f1d79 (running kernel: 6.5.13-1-pve)) and Ceph Reef 18.2.1. To test future changes, I created a virtual test bench in VirtualBox...

Having see the Ceph blog post about RocksDB performance today, I was keen to see what packages were available which include the fixes. I the bug ticket I see bug ticket I see comments about applying the fixes to Proxmox Ceph packages, but looking in git repo, I don't see the fixes in the commit...

Example- **************** Cluster- node 1-> has VM-1(on local storage) node 2-> has VM-2(on local storage) I am already using Ceph and HA. I want to use VM-1 and VM-2 "tmp" directory to be synced. I was thinking of mounting some storage from the Ceph storage pool in VM-1 and VM-2 for...

I have (had) a Promox 8.1 cluster with 2 nodes and one qDevice as 3rd witness /etc/ceph/ceph.conf [global] auth_client_required = cephx auth_cluster_required = cephx auth_service_required = cephx cluster_network = 10.227.101.33/24 fsid = something...

flow: 1 servers had reboot due to power maintenance, 2 (after the reboot) i noticed one server had bad clock sync - fixing the issue and another reboot solved it) the 3. after time sync fixed cluster started to load and rebalance, 4 it hang at error state (data looks ok and everything stable and...

Hi, We have several Proxmox hosts that have a Ceph storage and are connected to each other. Technically Ceph works, but for one specific host there is always this error message on all of it OSDs (No matter on which host we use the Web UI): OSD '29' does not exist on host 'SRV-Host' (500) The...

I need to build a 4 node Ceph cluster and I need an effective capacity of 30TB. Each node is configured like this: Supermicro 2U Storage Server 24 x NVME, X11DPU, Dual 1600W 2 x Intel Xeon Gold 6240 18 Core 2.6Ghz Processor 768G Ram 2x 100G Network 6 x Samsung PM9A3 3.84TB PCIe 4.0 2.5...