Yes, as it happens. I have been doing similar for years.
I ran openwrt as a raw image in a VM for a while, then migrated to hosting a container with Podman.
Security is obviously better within a VM, so I host the container runtime in a VM.
The issue of upgrading, has always been well, an issue...