Integrating Proxmox with Kubernetes for AI/ML Pipeline Automation on an AI PC

[gottliebmike]

Hi Proxmox Community,

I am currently working on optimizing my AI PC setup, which is running Proxmox VE, for advanced AI/ML workloads. My objective is to integrate Kubernetes into this environment to automate the deployment and scaling of machine learning pipelines. The AI PC is equipped with a high-performance GPU and sufficient resources to handle intensive training and inference tasks. I’m particularly interested in leveraging Proxmox to manage virtual machines and containers while Kubernetes orchestrates the workloads across these resources.

Specifically, I’m looking for guidance on:

1. Configuring GPU passthrough on the AI PC to enable Kubernetes pods to access hardware acceleration.
2. Efficiently managing storage and network resources between Proxmox and Kubernetes.
3. Any best practices or tools for achieving seamless integration in a single-machine setup.

I’d greatly appreciate any insights or advice from those who’ve experimented with similar configurations.

Thanks in advance!