Docker support in Proxmox

[chr1s]

sorry that I reopened this old discussion with my comment(s). People still seem to have strong opinions about how containers fit in their infrastructure. Didn’t mean to start a religious discussion about it.

To conclude from my side, I really like the overall direction Proxmox is taking in recent times (firewall, cloudinit, etc. But also the new backup server!). I think many people are using Proxmox as a lightweight private cloud these days. At least it prevents me from running a fat, complex OpenStack installation. I only wish the cloudinit support would be more complete (set userdata in the web interface, etc) and there was officially supported Terraform support.

Regarding containers: On any public cloud OCI/Docker containers run in VMs (alone for security reasons). So what Proxmox lacks a bit here is orchestration/management of that. I would wish for better support here (similar to the direction VMware is taking with their Kubernetes features), but I can understand if it’s out of scope.

But better cloudinit support would be really important imho so that Proxmox can at least fully serve a AWS EC2 like usecase and users can then run Kubernetes distros on top. Things are close, but not yet fully there.

 

[hr556]

sorry that I reopened this old discussion with my comment(s). People still seem to have strong opinions about how containers fit in their infrastructure. Didn’t mean to start a religious discussion about it.

To conclude from my side, I really like the overall direction Proxmox is taking in recent times (firewall, cloudinit, etc. But also the new backup server!). I think many people are using Proxmox as a lightweight private cloud these days. At least it prevents me from running a fat, complex OpenStack installation. I only wish the cloudinit support would be more complete (set userdata in the web interface, etc) and there was officially supported Terraform support.

Regarding containers: On any public cloud OCI/Docker containers run in VMs (alone for security reasons). So what Proxmox lacks a bit here is orchestration/management of that. I would wish for better support here (similar to the direction VMware is taking with their Kubernetes features), but I can understand if it’s out of scope.

But better cloudinit support would be really important imho so that Proxmox can at least fully serve a AWS EC2 like usecase and users can then run Kubernetes distros on top. Things are close, but not yet fully there.

That's exactly the thing, I would also love more cloud-init capabilities in terms of user-data directly setable in the WebUI as well as feature-parity with the cloud-init implementation in Openstack.

Reason: many KVM images with cloud-init support only work well using Openstack, with Cloudstack or any other KVM-based infra it's often a workaround-mess to get the same functionality.

 

[morph027]

I only wish the cloudinit support would be more complete (set userdata in the web interface, etc) ...

You can at least use cloudinit data from snippets, which can be edited through the webinterface.

https://pve.proxmox.com/wiki/Cloud-Init_Support#_custom_cloud_init_configuration

 

[Ramalama]

Very old thread and it's basically dead, so i don't need to reply to anyone

But with openzfs 2.2, docker will be working flawless inside lxc containers.
I'm preparing a test right now, just have some troubles atm compiling the kernel with zfs for Proxmox. Basically im trying to compile the 6.3 kernel with openzfs 2.2rc1.

However long story short, i think that running docker/kubernetes/containerd is anyway better suited inside an lxc containers.
I mean you can do backups and migrate them etc...
Imagine how much work that would be for the Proxmox devs, to implement native docker support that is cluster"izable"

However, i would rather suggest to implement lxd, to proxmox.
Lxd utilizes lxc at the same way as Proxmox does, but it expands lxc containers to be clusterizable.
Means allows for proper HA, without the shutdown/migrate/restart route + some other nice features.
Lxd utilizes kvm either, which is useless to us, but it adds at least mainly a lot features to lxc.

Especially since docker won't be an issue anymore on lxc containers with openzfs.

Btw, im running docker containers on Unprivileged lxc containers on ext4 backend storage since almost forever, and it worked always very perfect.

Lately im running even docker containers inside unprivileged lxc container with overlay2 and nesting only on zfs.
And it works with 98% of the containers amazingly well either.
I stumbled only over 2 docker images so far, that didn't worked with this method, one of them is speedtest-tracker.

However, it's a suggestion about lxd. So if it comes or not, doesn't matter for me very much either, since im extremely happy with Proxmox anyway.

Cheers

 

[LnxBil]

But with openzfs 2.2, docker will be working flawless inside lxc containers.

That's great news. I've been wanting this for years after experiencing zfs delegation in jails with FreeBSD.

 

[stefanobertoli]

Using with success docker inside unprivileged lxc on top of ceph. Nothing too complex but never had an issue. As I wrote in this thread some time ago, + 1 to not use docker directly un proxmox host.