Kubernetes storage?

[dragon2611]

Just wondering what people are doing for kubernetes PV's when running K8s/K3s in VM's on-top of a proxmox cluster.

I was thinking of exposing PVE-CEPH to rook as an external cluster and doing it that way , but I'm not sure if that's likely to bite me later or if it will cause issues with getting support for proxmox.

 

[pcuci]

had you any luck @dragon2611 ?

 

[dragon2611]

I had stability issues and went with iscsi to a truenas vm which also had stability issues.

Turned out to be something to do with rke2 and I think it was almalinux I was using initially for some reason those vms kept dropping network long enough to bork the storage connections.

K8s via kubespray on debian based vms wasn’t having the same network issues but by that time I’d gone too far down the iscsi path that redoing the ceph setup would be painful.

I believe the rook-ceph external cluster operator should work and I think they fixed a bug in raised relating to EC pools (I think it was backwards variables)