Node not appearing under ceph OSD when created

[MarkjT]

We have been testing proxmox with ceph for the first time and have come across a problem where we have three nodes in proxmox cluster, ceph hammer installed. We have created three monitors and created OSD disks on all of the nodes but when we create the OSD, two nodes appear but one does not. Does anyone know why this might be ?

Thank you for your help,

 

[tom]

Ceph Hammer is a bit outdated, please use Ceph Jewel.

Do you have any error logs?

 

[MarkjT]

Thanks for the quick response, will try to upgrade to jewel tomorrow and see how we get get on.

 

[MarkjT]

We are still seeing the same issue as before. We have reloaded our 3 servers this morning, upgraded them and installed ceph jewel. On our first node we add the OSD and again, the node is not appearing. We carried on and created OSD's on node2 and node3 and they have appeared as before. If we look at the ceph information, we only see node2 and node3 - no node1. Log file information -:

root@node1:~# ceph health detail |more
HEALTH_WARN 128 pgs degraded; 128 pgs stuck degraded; 128 pgs stuck unclean; 128 pgs stuck undersized; 128 pgs undersized
pg 1.e is stuck unclean for 546.227916, current state active+undersized+degraded, last acting [0,1]
pg 0.f is stuck unclean for 2116.154538, current state active+undersized+degraded, last acting [0,1]
pg 1.f is stuck unclean for 546.227915, current state active+undersized+degraded, last acting [1,0]
pg 0.e is stuck unclean for 2116.154547, current state active+undersized+degraded, last acting [0,1]
pg 1.c is stuck unclean for 546.227958, current state active+undersized+degraded, last acting [1,0]


the nodes have two network cards, one for lan and one for storage, the network subnet for the storage is 10.0.0.0/24

We followed the instructions and ran the following commands to start ceph on node1 -:

pveceph init --network 10.0.0.0/24
pveceph createmon

We then created the other two monitors using the web interface - all three monitors appear fine. We then created the OSD for node1 and it said it had created successfully but it is not appearing under the OSD's.

Are we doing something wrong ? Watching the video the nodes just appear but we are not seeing this.

Thanks for your help !

 

[MarkjT]

Just for your infomation, we are wondering if this is hardware specific, the box that is not creating the OSD (node1) is an HP DL160 G6, we have disabled RAID on the box.

 

[MarkjT]

OK we have found the issue, after using dd if=/dev/null of=/dev/sdx on the disks it is now working!