cluster

  1. L

    cluster issues after upgrading to pve9

    Hello, I just updated my cluster to proxmox 9, and most nodes went well, except 2 of them that ended up in a very weird state. Those 2 nodes hung at "Setting up pve-cluster". And I have noticed that /etc/pve was locked (causing any process that tried to access it to lock in a "D" state) The...
  2. L

    broken cluster

    i had a cluster with 4 nodes and a qdevice so 5 votes. I wanted to remove 1 node and the qdevice because I experienced split brain. after trying to remove one node it sees only itself in a cluster but the real cluster has it still listed as offline so I can't use pvecm delnode to remove it...
  3. M

    How to properly remove node from cluster?

    Hi all, I am looking for some guidance on the clean removal of a node from Proxmox cluster. What I did so far: - Created cluster named 'Test-PVE' - Added three nodes (proxmoxVE01-03) to the cluster - Verified cluster manager status and nodes via 'pvecm status' and 'pvecm nodes' -> all three...
  4. S

    2 node cluster setup advice

    I’m experimenting with setting up a converged Proxmox cluster and only have two nodes. Adding a third is not an option at the moment, unless I use a much weaker leftover server. I am looking for any advice from people whom might have ran a two-node cluster in production? On the other end would...
  5. K

    Cluster design

    Hi I have 3 dell R rack servers - there are in 1 cluster ... they have 10G networking 3 beelink mini me .. 2.5g eth and in 1 cluster 1 laptop standalone proxmox I'm in the process of migrating all of my disk to the dell servers and the cluster. and attaching the beelink cluster and the...
  6. D

    Deploying a colo

    Hello everyone, I am hoping some of you can help me out with some info I am putting together. I work for a managed service provider and we are looking to deploy our own colo for our clients. I do have a Proxmox server for my own personal use but its only one host and my company is looking at...
  7. G

    CPU Empfehlung - 3 Node Cluster

    Hallo zusammen, aktuell plane ich den Aufbau eines Cluster mit 3 Nodes und Ceph als Storage mit 10G Anbindung. Darauf laufen soll verschiedenes: - div. Windows VMs (DC, FS, IIS etc.) - Linux VMs (Tailscale Router, mehrere Docker VMs, Plex, Loxberry etc. ) - LXC (Cloudflare DDNS, paperless...
  8. P

    CEPH Erasure Coded Configuration: Review/Confirmation

    First, let me contextualize our set-up: We have a 3 node cluster, where we will be using CEPH for storage hyperconvergence. We are familiarizing ourselves with CEPH and would love to have someone more experienced chiming in: All of our storage hardware are SSDs. (24x 2TB NVMe, 8 per server)...
  9. G

    Is clustering production-ready on Proxmox VE 8.2.2?

    I have 8 Proxmox VE 8.2.2 hosts. Each host is built the exact same way, running the same hardware. Besides the pro of everything being accessible from one clean GUI and VM moves being a breeze (compared to my current PBS backup and restore method), what other potential pros would I gain from...
  10. Jan Wedershoven

    Cluster reboot after adding a new node

    Hi all, I'm running a PVE cluster with 18 nodes and about 750VMs, which has been running stable for several months. Last week I've added a 19th node. The node was added to the cluster, and after 60 seconds, watchdog-mux simultaneously triggered a restart of all 18 existing nodes (the new node...
  11. E

    Distributed Power Management (DPM)-style functionality in Proxmox VE?

    Hello everyone, I’m exploring ways to reduce power consumption in my Proxmox cluster, and I wanted to ask if there is already a feature (or recommended approach) similar to VMware’s Distributed Power Management (DPM). Use case: I run a Proxmox cluster with 6 nodes. Most of the time, the...
  12. O

    Best practice setup for Proxmox Backup Server and NAS on the same Node

    Hi there i already have a PVE Server up and running in my HomeLab. Now i plan to expand my HomeLab with a second Server. Actually i use Open Media Vault in a VM on my PVE Server for my NAS Solution. My new Server Rack will have HotSwap Cases so i want to move my NAS to the new Server. The new...
  13. P

    Proxmox boot completely destroyed(?) after creating a cluster. Fixing the boot partition?

    I've had my Proxmox server set up for months now, it runs on an R5 3600 with 64gb 2933mhz ram on a B450M Gaming. It runs my Truenas array with a passthroughed HBA, and a Pterodactyl server on Ubuntu. I had just finished installing Proxmox on my second computer, and created a cluster through the...
  14. F

    Cluster based vnc / console error

    I have a four node cluster. For clarity hostnames this example the hosts are host1, host2, host3, host4 All running 9.0 which has been pretty stable so far. Suddenly today essentially out of nowhere, which I'm sure won't turn out to be true, I can only login to the shell of a host or vm or lxc...
  15. L

    VMs not migrating when Ceph is degraded in 3-Node Full-Mesh Cluster

    Hello Community, I am currently setting up our new 3-Node Proxmox Cluster, pretty new to Proxmox itself. We are Using Full-Mesh with 25Gbit/s cards for Ceph, 10Gbit/s cards for Coro/VMBR and 18 (6 per Node) SATA 6G Enterprise SSDs. Ceph performance took a bit of testing, but we are now at a...
  16. G

    [SOLVED] Adding node with unique vm ids to existing cluster

    Hi, I searched the forums and didnt find a solution for my case. So im going to try to explain myself the best i can :) I got 4 proxmox nodes, 3 at home and 1 in a datacenter. The 3 at home are in a cluster, all with unique vm ids based on the node i roll them out. i use Ansible to automate...
  17. H

    [SOLVED] Unable to migrate containers

    Hello all! This is the first time I've used the migrate feature. I have two nodes in a cluster, and I was looking to move all containers from Node 1 to Node 2. I used the bulk migration option, and it migrated more than half of the containers that I have. However, for some reason, there are a...
  18. J

    Create Cluster - No network interface available ?

    [Update] Found a workaround with pvecm create cluster-name --link0 192.168.2.20 but still wondering why it didn't come up in the UI :confused: New to Proxmox VE ;) Background info: Proxmox VE 9.0.5. Couple of days ago, I did a reboot of this node which didn't go well. For some reason the...
  19. C

    what do you think of this Proxmox/ceph Cluster ?

    So I have this cluster in mind: PLEASE keep in mind the availability of hardware be it new/used server/workstation hardware is quit unorthodox and different Here from what's available in the us/eu. for example a single used epyc 9654 costs 10x a 9950x and that's just a single cpu, a single...
  20. C

    [SOLVED] Newly added NIC does not work in cluster nodes

    Hello, it is my first thread so sorry in advance for errors. So just some context. I have an cluster with 6 nodes, all on PVE 8.4- Currently they are running on the internal network interface on the mainboard. I need to add an NIC and let it run over it and use the internal one for intel KVM...