Ceph.conf entry for cluster network

[wahmed]

I am intending to separate Ceph cluster network from public network. To do that i added "cluster network = x.x.x.x/xx" in global section of ceph.conf.
But now it is giving me a warning:

warning line 13: 'cluster_network' in section 'global' redefined

From bandwidth monitor on the cluster network interfaces of nodes shows that ceph data indeed are travelling on cluster network. Or is it really not? Should the entry be different than what i used?

 

[RobFantini]

maybe a typo in ceph.conf .

is there a '_' between cluster and network? I don't have that here.

 

[wahmed]

maybe a typo in ceph.conf .

is there a '_' between cluster and network? I don't have that here.

No '_' in the entry. It is same as the public network entry. My cron daily logrotate report is full of this one liner warnings.

 

[RobFantini]

do the mon and osd processes need to be restarted on all nodes?

 

[wahmed]

do the mon and osd processes need to be restarted on all nodes?

I restarted all the nodes after making the changes to make sure the new changes takes effect.

 

[RobFantini]

Wasim, can you attach ceph.conf ? maybe someone will spot an issue.

 

[wahmed]

Wasim, can you attach ceph.conf ? maybe someone will spot an issue.

Funny, but while copy/pasting the ceph.conf here i noticed that there was a cluster network entry already in the ceph.conf. I did not notice it before, i thought Proxmox only added public network entry. I am going to restart all mon/osd now to see if i am still getting the warning.
Thanks Rob for the tip to post ceph.conf!!