I still had a connection after the reboot, I just wasn't getting the speed I should.
We have tested using iperf between the two x520's and we are getting speeds about 564Kbits/sec so we know there is a problem.
Moving both nics to Windows does solve the problem, so I believe the problem is...