Patches are important due to security fixes they contain. Just from this perspective you should upgrade your gear / software.
For me it took only about 30 minutes. Installation, shutdown of VMs, reboot, Start of VMs
I am running a single-server at home