Thanks for the replies.
It is certainly not a duplicate IP.
The firewall suggestion is good, going to look into that.
Funny thing is that it only happens on first boot, not on subsequent reboots of the container or the server.
And I haven't checked if the same thing happens on IPv4, all my...