Okay, so when figuring out that I've been using the wrong IP all along, it came quite obvious that my router forwards where wrong as well. Pointing them to the VM's IP instead of the server, it's now working as intended. I guess it takes some time to figure out "how to think" when working with...