So, it seems to be the IPV4 DHCP setting. If I run with a static IP, the LXC image boots normally. If I ask for IPV4 DHCP, it hangs 5 minutes on boot, though it gets the lease.
After a little more careful testing, I think this may be happening with more than just ubuntu - seems to also...