Looking for the best ways to Implement Proxmox

[robertboyer]

Hello : We are implementing a service for a customer who wanted to manage the GPU based VMs for AI/ML workloads. We are exploring the simplest way to implement this. They are not very keen on managing ProxMox in our data center. But they prefer to have some control on the VMs as well as having the ability to handle live migration.

We were looking around variuos solutions and perhaps it is already availble in Proxmox.

1. Can we set up a ProxMox cluster and just give API access to ProxMox for them to integrate in their web application? I am not sure if this would allow live migration of live VMs etc.

2. Is it a good idea to go with Operator managing ProxMox server on their own and Give LXC container access via LXD to our customer?
Plan is to install LXD in a VM and connect the LXCs to LXD and let the customer use the LXD API for their website. I heard that this might give separate control for the platform between operators and customers.

3. Go with Nomad as additional layer?

Any thoughts are appreciated. New to ProxMox and loving so far what we came across.

 

[Dunuin]

I think live migration of GPU accelerated VMs won't work, because of the PCI passthrough.

 

[caremedical]

I was thinking of the same as well. PCI passthrough won't allow live migration. But if the other person has vGPU with NVIDIA driver support, it might allow live migration. Its one of those A100 or A6000 GPUs. Never tested, but guessing.