K3s on LXC

Panderiner

Member
Feb 25, 2021
5
1
8
This has been posted several times, but no thread arrives to a satisfactory solution. Several people manage to deploy some k8s distro over LXC so I know it's possible but I haven't seen anyone doing on PVE. So question is: Anyone did it?, How?.

I've tried with alpine, and debian templates. Loading the kernel modules directly into the host and lsmod in the CT, I have set the recommended configs in /etc/pve/lxc/xxx.conf, etc I still can't make them work. I get modules loading errors in the continers and eventually kubectl get nodes gives an error:

Bash:
root@k3s:~# k3s kubectl get node
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?


while having this:

Bash:
root@k3s:~# lsof -i -P -n | grep LISTEN
sshd      222 root    3u  IPv4 2051757      0t0  TCP *:22 (LISTEN)
sshd      222 root    4u  IPv6 2051759      0t0  TCP *:22 (LISTEN)
master    327 root   13u  IPv4 2054219      0t0  TCP 127.0.0.1:25 (LISTEN)
k3s-serve 517 root    7u  IPv6 2061510      0t0  TCP *:6443 (LISTEN)
k3s-serve 517 root   16u  IPv4 2061514      0t0  TCP 127.0.0.1:6444 (LISTEN)
container 557 root   15u  IPv4 2061589      0t0  TCP 127.0.0.1:10010 (LISTEN)

Also don't know why is listening on port 6443 only for ipv6 and not both.

I just install k3s with the recommended one liner.

Bash:
curl -sfL https://get.k3s.io | sh -
  # Check for Ready node,
  takes maybe 30 seconds
  k3s kubectl get node

Any experience with this?