cluster ceph

First, let me contextualize our set-up: We have a 3 node cluster, where we will be using CEPH for storage hyperconvergence. We are familiarizing ourselves with CEPH and would love to have someone more experienced chiming in: All of our storage hardware are SSDs. (24x 2TB NVMe, 8 per server)...

Hello Community, I am currently setting up our new 3-Node Proxmox Cluster, pretty new to Proxmox itself. We are Using Full-Mesh with 25Gbit/s cards for Ceph, 10Gbit/s cards for Coro/VMBR and 18 (6 per Node) SATA 6G Enterprise SSDs. Ceph performance took a bit of testing, but we are now at a...

Hi all, I'm new to Proxmox, for many years I've worked with VMware, but I'm start to enjoying Proxmox very much and now I'm migrating all the solutions I manage to Proxmox. One of those solutions is a VMware cluster that I intend to replace with a Proxmox Cluster. So, I got 3 servers, with...

Hi folks, I'm trying to manually migrate (live migration) of a VM from a single node proxmox to a proxmox cluster. I have tried many different things, like checking the fingerprint, permission on the token, tried with vm online and offline, and many other but I can't get rid of the error device...

I have a 3 node proxmox cluster running Ceph. Recently is gave a warning that one of the three monitors is down or "out of quorum". root@pve-02:~# ceph -s cluster: id: f9b7ff0a-17b9-40d8-b897-cebfffb0ee8d health: HEALTH_WARN 1/3 mons down, quorum pve-01,pve-03...

Let me preface this by saying I'm not a networking engineer, I have a technical background but in this area I'm a hobbyist; this is my first post here, please tell me if I'm doing anything wrong, and English is not my first language, so forgive me if something is not clear or is phrased poorly...

Hello all, I have a 3-node cluster set up using the guide here: https://packetpushers.net/blog/proxmox-ceph-full-mesh-hci-cluster-w-dynamic-routing/ Everything was working fine when using Ceph Quincy and Reef. However, after updating to Squid, I now get this error in the health status...

Hello, I work for multiple clients and one of them wanted us to create a Proxmox cluster to assure them fault tolerance and a good hypervisor that's cost-efficient. It's the first time we put a Proxmox cluster in Production environment for a client. We've only used single node proxmox. Client...

Hello everyone, So, I've decided to give proxmox cluster a go and got some nice little NUC-a-like devices to run proxmox. Cluster is as follows: Cluster name: Magi Host 1: Gaspar VMBR0 IP is 10.0.2.10 and runs on eno1 network device vmbr1 IP is 10.0.3.11 and runs on enp1s0 network device...

TL ; DR - I don't care which host the High Availability VMs move to, as long as it doesn't exceed 4 VMs per host. Can this be done? Full Story - I am planning out a 4 host cluster (and 1 QDevice) of PVE with HA active using CEPH Storage and plan to run 8 Windows Server VMs across all hosts. I...

Hello, I'm new to Proxmox. So, if any term is wrong help me out. I have a HPE Proliant DL380 G6 with 7 disks at my lab. I have installed Proxmox on two of the disks with RAID 10. I have left the other ones out of the RAID as I want to test Ceph for my environment. The other five disks are not...

I have bought 3 identical servers, both have a 10gbe network adapter with dual ports. I want the cluster to communicate via the 10gbe network adapter but each individual server via 1gbe port to the router. If one of the nodes fails, i want it to fallback to the next server. So far, i have...

Hi, i get the error message "595 Connection refused" if i try to manage 2 of a 4 nodes cluster. This is a production cluster and every node comes with 1 dedacted 10gig nic which one with 2 ports, one for HA and one for Ceph. The manage network is on default 1gig nic, checking on logs i'll see...

Hi all, I am trying to build a local 3 node Proxmox cluster with Ceph for HA These would be the 3 server nodes MBO: ASUS ProArt B650-CREATOR CPU: AMD Ryzen 9 7900 MEM: 128GB DDR5 PVE SSD: 2 x Micron 7400 PRO M.2 1.92TB on MBO Ceph storage: 4 x Micron 7400 PRO M.2 1.92TB on ASUS Hyper M.2...

Hello folks, totally new to proxmox clustering and just recently got 2 mini pcs for a home lab. As I was setting up the ceph cluster installation when I got to creating the osd, i couldn't target any disks as the single 1TB SSD I have is in use by proxmox. I followed the default configs for...

I am having a dilemma with my server configuration, namely I have 2 servers running at Home. Problem Statement: I am considering to setup 3 node Proxmox HA Cluster with CEPH considering all 3 nodes with same specs as Server 1 (given below). If I were to do this, what kind of performance gains...

Hello, I would like to set up a Proxmox HA cluster with 2 nodes. I can't use Ceph with only 2 nodes, so I wanted to try replication. With replication, you can set the container to be replicated every 15 minutes, for example. But then I asked myself a question: If my container is running on...

I need to build a 4 node Ceph cluster and I need an effective capacity of 30TB. Each node is configured like this: Supermicro 2U Storage Server 24 x NVME, X11DPU, Dual 1600W 2 x Intel Xeon Gold 6240 18 Core 2.6Ghz Processor 768G Ram 2x 100G Network 6 x Samsung PM9A3 3.84TB PCIe 4.0 2.5...

Hello community, My first post here. I have been searching on the subject and the posts I have seen on the forum and by search engines on the subject have not finished me clarify my doubt. To put in context. I have 3 PVE Nodes in Cluster with CEPH as backend storage for the VMs. In the ceph...

Hi, to set the context, I want to connect my ceph cluster to my proxmox cluster, I did the same thing as leihnix Post reference: the https://forum.proxmox.com/threads/using-external-ceph-cluster.93453/ I also see that my pool is visible with a question mark but the size is not available, do you...