Maintenance mode GUI indication

[senadman]

Hello all,

I am running a 3node cluster with Ceph reef in HA. When I run the maintenace mode command for one node VM's migrate from the node as expected but the node indication in the GUI doesn't change, it remains green. All tasks in the log have completed.

I am unsure now whether or not I can reboot/service the node safely or not - is there another way to validate whether the node is in maintenance mode or not ?

 

[senadman]

OK to answer my own question apparently there is no way to validate if a node is in maintenance mode, shell or GUI - in my opinion there should be.

This is good read for anyone interested Link

 

[mram]

Datacenter > HA does show if a node is in maintenance mode.

root@nx1a:~# ha-manager status
quorum OK
master nx1d (active, Thu May 16 20:31:13 2024)
lrm nx1a (idle, Thu May 16 20:31:17 2024)
lrm nx1b (idle, Thu May 16 20:31:18 2024)
lrm nx1c (maintenance mode, Thu May 16 20:31:19 2024)
lrm nx1d (idle, Thu May 16 20:31:18 2024)

 

[mram]

A follow up picture. Maintenance mode only shows in Datacenter / HA after you have setup a group and added a VM as a resource to the group.



My node maintenance script:

## Usage: enablemaint.sh node-1a (node name as first parameter here)
## Take a node offline, set CEPH not to failover while node reboots
ha-manager crm-command node-maintenance enable $1
ceph osd set noout
ceph osd set norebalance
ceph osd set norecover
ceph osd set noscrub
ha-manager status

## Usage: disablemaint.sh node-1a
## Bring a node back online, resume normal CEPH
ha-manager crm-command node-maintenance disable $1
ceph osd unset noout
ceph osd unset norebalance
ceph osd unset norecover
ceph osd unset noscrub
ha-manager status

Note: If you want to use maintenance mode to force HA to move VMs, you might want to split these into 2 scripts. Let the nodes migrate before putting CEPH in noout/norebalance mode. Then there will be less CEPH recovery when the node comes back up. Or just move the vms around before starting maintenance mode altogether.