Build a ceph storage cluster

badji

Renowned Member
Jan 14, 2011
237
36
93
hi,

I try to create a cluster following this tutorial, with 3 servers with 3 disks.
First drive of each server I installed ubuntu-server ceph 12.04 and as explained in the tutorial.
The other two disk of each server, I've formatted trying both formats btrfs or xfs:

mkfs.xfs /dev/sdb
mkfs.xfs /dev/sdc

or

mkfs.btrfs /dev/sdb
mkfs.btrfs /dev/sdc

it works

but after, when I type: /etc/fstab, I still have the error message : bash: /etc/fstab: Permission denied.

I tried to see the problem but so far I have not found a solution and I'm stuck.
If somebody can help me with pleasure.

thank you
 
but after, when I type: /etc/fstab, I still have the error message : bash: /etc/fstab: Permission denied.

Which is correct - you can't execute /ect/fstab.

I guess you want to edit /etc/fstab instead? Try

# vi /etc/fstab

or

# nano /etc/fstab
 
Thank you Dietmer

I kept the heads, but now I have another error message with the command :

mkcephfs -a -c /etc/ceph/ceph.conf -k ceph.keyring

and the message is :
temp dir is /tmp/mkcephfs.hkyvz2Cble
preparing monmap in /tmp/mkcephfs.hkyvz2Cble/monmap
/usr/bin/monmaptool --create --clobber --add a 192.168.100.21:6789 --add b 192.168.100.22:6789 --add c 192.168.100.23:6789 --print /tmp/mkcephfs.hkyvz2Cble/monmap
/usr/bin/monmaptool: monmap file /tmp/mkcephfs.hkyvz2Cble/monmap
/usr/bin/monmaptool: generated fsid 48cd177f-e488-4c3d-a5d3-6918e4dac093
epoch 0
fsid 48cd177f-e488-4c3d-a5d3-6918e4dac093
last_changed 2012-07-23 16:23:20.506286
created 2012-07-23 16:23:20.506286
0: 192.168.100.21:6789/0 mon.a
1: 192.168.100.22:6789/0 mon.b
2: 192.168.100.23:6789/0 mon.c
/usr/bin/monmaptool: writing epoch 0 to /tmp/mkcephfs.hkyvz2Cble/monmap (3 monitors)
=== osd.0 ===
2012-07-23 16:23:20.774728 7fbe2d50d780 -1 OSD::mkfs: FileStore::mkfs failed with error -2
2012-07-23 16:23:20.774797 7fbe2d50d780 -1 ** ERROR: error creating empty object store in /srv/osd.0: (2) No such file or directory
failed: '/sbin/mkcephfs -d /tmp/mkcephfs.hkyvz2Cble --init-daemon osd.0'

I have the same message with brtfs or xfs filesystem.

Thank you.
 
Code:
/srv/osd.0: (2) No such file or directory

you need to create these directories manually.
 
Thank you Tom,

But the directory /srv/osd.0 already exists

# mkdir /srv/osd.0
mkdir: impossible de créer le répertoire «/srv/osd.0»: Le fichier existe

thank's
 
I suggest you also try to get help via the ceph community.
 
Tom thank you for your help.
I just want to tell you that creates part of the file since he wrote in / srv/osd.0

when I go to the directory / srv/osd.0
ls shows me:
current fsid store_version

or why should the command does not run completely?

thank you