If I reboot a node DRBD does not shutdown cleanly.
At first I thought maybe this was an issue with the order services were turned off, so I adjusted drbd to turn off after pve-cluster.
That did not help.
Next I manually turned off services using the same order they would normally be turned off.
After turning off pve-cluster, drbd was next but instead of shutting down I got this error:
That reminded me of this thread: forum.proxmox.com/threads/6720-Device-mapper-doesn-t-remove-the-device-in-a-clustered-setup
I looked in /dev/mapper and /proc/partitions and sure enough, some LVM disks on the DRBD volumes were still in /proc/partitions
I ran these commands:
Then I was able to cleanly turn off drbd and reboot.
I notice this because everytime I rebooted when DRBD re-connected it was synchronizing data.
That did not happen when I manually turned off each service and ran the dmsetup commands.
Any suggestions on how to fix this problem?
At first I thought maybe this was an issue with the order services were turned off, so I adjusted drbd to turn off after pve-cluster.
That did not help.
Next I manually turned off services using the same order they would normally be turned off.
After turning off pve-cluster, drbd was next but instead of shutting down I got this error:
Code:
Stopping all DRBD resources:/dev/drbd0: State change failed: (-12) Device is held open by someone
/dev/drbd1: State change failed: (-12) Device is held open by someone
ERROR: Module drbd is in use
That reminded me of this thread: forum.proxmox.com/threads/6720-Device-mapper-doesn-t-remove-the-device-in-a-clustered-setup
I looked in /dev/mapper and /proc/partitions and sure enough, some LVM disks on the DRBD volumes were still in /proc/partitions
I ran these commands:
Code:
dmsetup remove /dev/mapper/drbdvg0-vm--100--disk--1
dmsetup remove /dev/mapper/drbdvg1-vm--102--disk--1
Then I was able to cleanly turn off drbd and reboot.
I notice this because everytime I rebooted when DRBD re-connected it was synchronizing data.
That did not happen when I manually turned off each service and ran the dmsetup commands.
Any suggestions on how to fix this problem?