As usual, the problem is between the keyboard and the chair, though I can't help but feel the whole thing could be a little more user friendly somehow. It turned out I was passing PCI 04:00 to a VM, so when the NIC got that address, it was no longer visible to the host. Disabled that...