You should at the very least patch Meltdown, as it is the easiest one to "use". So that means patching guest, rebooting it.
Spectre needs microcode update, intel has release some already to certain companies like HP, Dell, Supermicro and they've created bios updates for some cpus / servers. It...