Thats, the problem :( The open source nvidia driver sucks (Nvidias fault) you need to blacklist that shit. You will get a lower resolution (who cares, this is a server :D), BUT it works, trust me.
- nano /etc/modprobe.d/blacklist-nouveau.conf
paste this:
blacklist nouveau
blacklist...