It looks like pve-cluster service is responsible for it. I tried the steps here and still no changes are made to /etc/pve/.members
https://blog.dob.sk/2018/07/09/fix-invalid-node-ip-in-etc-pve-members/
https://blog.dob.sk/2018/07/09/fix-invalid-node-ip-in-etc-pve-members/