PowerEdge R510
The solution for me was to set the NVRAM clear jumper, power the server on, let it post, power it off, move the jumper back.
It seems on some (Dell at least) servers, removing UEFI boot entries doesn't completely remove them, and the UEFI storage eventually fills up, which is...