Creating K8 rancher on top of Proxmox?

[tbaror]

I am in process of creating k8 racher on top of Proxmox cluster with 3 nodes and ceph storage , my idea where creating 3 containers on all 3 nodes and on top of them ra my rancher, looking on several tutorials i saw that all of them are using vm instead of container, so my question is there particulate reason for doing so ?

my next question is how do k8 rancher can provision resources from proxmox to create containers is there a way or al of my pods should live under the rancher container?

Please advice

Thanks

 

[LnxBil]

so my question is there particulate reason for doing so ?

Security. Just look at the Docker on LXC debate and all the drawbacks with respect to security (better isolation, own kernel, etc.).

Also, the high availability is much better with VMs. I see such a setup as an IaaS Layer with PVE and an arbitraty number of nodes n with n >= 3. On top of that you run your CaaS layer with rancher nodes. If you have a maintanance window for your IaaS node, just live migrate the CaaS node to another IaaS host and do your maintenance work on your PVE node. Without any "upper layer" interruption or problems.

my next question is how do k8 rancher can provision resources from proxmox to create containers is there a way or al of my pods should live under the rancher container?

As with most things ... there is not automation to do this, but there is automation to do KVM/VMs ... that gives altready an indication that there must be something wrong with the setup.