Managed to fix my issue but I'm not really sure what I did... I tried setting IP addresses on the NICs, changed stuff around in the /etc/network/interfaces file, rebooting, getting nowhere, and changed it all back again and suddenly it worked. I really cant see anything different in the config now when comparing to the output above. Also apt started working, I guess it switched to IPv6 when IPv4 did not work or something, and that is the output I saw.