[SOLVED] Automated Load Balancing Features or Recommended Implementations

Sebi-S

Sebi-S

Member
Proxmox Subscriber
Apr 19, 2022
43
5
13
Germany
Hello Proxmox Community,

I'm currently managing a Proxmox VE cluster and am looking into solutions for automated load balancing across multiple nodes. My goal is to ensure that VMs can be dynamically redistributed among available nodes based on resource utilization to optimize performance and prevent any single node from being overwhelmed.

I understand that Proxmox provides tools for manual live migrations and has a robust API that could potentially be scripted to automate this process. However, I am curious if there are any built-in features within Proxmox itself or any community-recommended practices or third-party tools specifically geared towards this kind of automation.

Has anyone successfully implemented an automated load balancing system in their Proxmox environment? If so, could you share insights into how you achieved this, any particular scripts, or external monitoring tools you used?

Any advice on potential pitfalls to avoid or documentation that could guide the setup would be greatly appreciated. Also, if such features are in development for future Proxmox releases, information on that would also be very useful.

Thank you for your assistance and looking forward to your expert advice.

Best regards,

Sebastian
 
  • Like
Reactions: babis430
Hi, I read about: https://github.com/cvk98/Proxmox-load-balancer but seems the developer does not have any time to maintain it anymore:

Unfortunately, I no longer have time to support the project and answer questions. I am ready to transfer all rights to it to anyone who wants to support and develop it. I will post a link to your repository. There are many interesting ideas in the pool request. If you are interested, write to me. I hope he helped a lot and made admin life easier =)Unfortunately, I no longer have time to support the project and answer questions. I am ready to transfer all rights to it to anyone who wants to support and develop it. I will post a link to your repository. There are many interesting ideas in the pool request. If you are interested, write to me. I hope he helped a lot and made admin life easier =)
Click to expand...

Currently theres only a rebelance on ha-start -> cluster-ressource-scheduling with static load option.
 
  • Like
Reactions: Sebi-S
On top of that, from the roadmap:

  • Cluster Resource Scheduling Improvements
(...)
  • Mid/Long-Term:
    • Add Dynamic-Load scheduling mode
    • Add option to schedule non-HA virtual guests too
Click to expand...
https://pve.proxmox.com/wiki/Roadmap#Roadmap
In other words: built-in load balancing is already being worked on (and re-balancing on startup is already implemented even since 7.4), but when it's being released is unsure for now still.
 
  • Like
Reactions: Sebi-S
I wonder if the author of ProxLB (https://github.com/gyptazy/ProxLB) is trying to get this into upstream pve by talking to the devs via dev-maillinglist?
Edit: I did not tryout ProxLB, but it seems people like it.
 
Last edited:
jsterr said:
I wonder if the author of ProxLB...
Click to expand...
The author is here, by the way: @gyptazy :-)

Also:
G

[TUTORIAL] Thread 'ProxLB - (Re)Balance your CT/VM workloads across nodes in your Proxmox cluster'

Introduction​

ProxLB (PLB) is an advanced tool designed to enhance the efficiency and performance of Proxmox clusters by optimizing the distribution of virtual machines (VMs) or Containers (CTs) across the cluster nodes by using the Proxmox API. ProxLB meticulously gathers and analyzes a comprehensive set of resource metrics from both the cluster nodes and the running VMs. These metrics include CPU usage, memory consumption, and disk utilization, specifically focusing on local disk resources. So basically, it is something like DRS for VMware.

PLB collects resource usage data from...
  • Like
 
  • Like
Reactions: Johannes S
You must log in or register to reply here.
Top Bottom