Proxmox cloud provider for kubernetes

Pablo Alcaraz

Member
Jul 6, 2017
53
8
13
53
  • Like
Reactions: Vladimir Bulgaru

locusofself

Member
Mar 29, 2016
39
3
8
38
Which tool are you hoping to have integration with exactly?

Its true that Google Compute Engine 'gcloud' command allows automatic creation of kubenernets clusters, as does 'kops' for AWS, etc.

But you can make your own kubernetes cluster in a variety of ways: kubeadm, manual installation, using CoreOS/tectonic, using conjure-up/juju ..


There isn't a comparable tool to gcloud or kops to automatically create a kubernetes cluster for you. I agree it would be nice to have, but its not stopping you from using kubernetes on your VMs.
 
  • Like
Reactions: Pablo Alcaraz

eloekset

New Member
May 14, 2020
2
0
1
41
I'm trying to use Ubuntu Server 18.04 and k3sup on a Proxmox server. Didn't go well on the first attempt, and for the second attempt, I was hoping to find some documentation on minimum requirement of disk allocation for the master and worker nodes. The default 32GB on each node is probably a waste of storage space for a simple dev/test cluster. https://github.com/alexellis/k3sup
 

mbosma

Member
Dec 3, 2018
96
11
13
28
I've been using this cloud provider for a while now:
https://github.com/lnxbil/docker-machine-driver-proxmox-ve

Tested and working with RancherOS iso and debian 10 prepared image + cloudinit.

Because of the massive amount of docker images being pulled by customers on their dev/test environments I create at least 50gb disks.
My image has a 10GB disk which also works if I wanted to keep my vm's as small as possible.
 

eloekset

New Member
May 14, 2020
2
0
1
41
I’ve successfully used VMs on Ubuntu Server 20.04.1 with 8GB disks now. Could probably go even lower, but I’ve so far only installed one container with ASP.NET Core 3.1 runtime and a very simple app.
 

cedvan

New Member
Oct 20, 2021
3
0
1
Lyon

mbosma

Member
Dec 3, 2018
96
11
13
28
Hi Cedvan,
My response is still in draft, must have forgot to press post.

mbosma, how did you add this custom cloud provider to rancher kubernetes engine please?
I Added the driver using the Rancher webgui under Global > Tools > Drivers > Node Drivers using the Add Node Driver button.
Here you can paste the link to the binary.
 

Cookiefamily

Active Member
Jan 29, 2020
132
36
33
Germany
I think Proxmox would still benefit a lot if they provided a 1st-party rancher driver.
We would prefer getting proper commercial support for this.
Also automatically load-balancing (moving) VMs would be somewhat of a requirement if you constantly have new VMs popping up and shutting down again.

Right now we only use AWS for autoscaling deployments - and if we want to host them on-prem, we would need to go with vmware which I don't really like. Our PVE setup has a lot better performance and is cheaper to maintain than our VMware setup. But I don't know if there is a way around VMware in those use cases.

I think Proxmox is missing out on a big growth market here by not making PVE "cloud native" - Harvester HCI is also slowly beginning to take shape and would be the open-source Linux-based alternative for provisioning K8s VMs. I really hope that PVE doesn't loose its touch with whats evolving in the industry right now, I love PVE and I would love to continue using it in the future.
 

lifeboy

Active Member
I think Proxmox is missing out on a big growth market here by not making PVE "cloud native" - Harvester HCI is also slowly beginning to take shape and would be the open-source Linux-based alternative for provisioning K8s VMs. I really hope that PVE doesn't loose its touch with whats evolving in the industry right now, I love PVE and I would love to continue using it in the future.
I share your sentiment and think PVE should be made "cloud native" as you call it.

A great additional, which I have only recently started playing with, is SDN integration into the GUI.

To have formal kubernetes support would be really great!

As far as auto-creation of clusters is concerned: I suppose it is possible to write a service to do this using LXC templates and the PVE API, not? Has anybody done something like this?
 

dsieradzki

New Member
Sep 12, 2022
1
0
1
@lifeboy I have created that kind of tool. It's open source but keep in mind it's in early stage of development. Maybe will help someone. Currently I'm working on big redesign of app, and big update will be dropped soon.
I have created this project due to lack of easy tool for creating Kubernetes cluster and I don't want to messing up with terraform and ansible. It's worth to mention, currently support only MicroK8S on Ubuntu Cloud image.
https://github.com/dsieradzki/k4prox
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!