Build a ceph storage cluster

badji

Renowned Member
Jan 14, 2011
235
32
93
hi,

I try to create a cluster following this tutorial, with 3 servers with 3 disks.
First drive of each server I installed ubuntu-server ceph 12.04 and as explained in the tutorial.
The other two disk of each server, I've formatted trying both formats btrfs or xfs:

mkfs.xfs /dev/sdb
mkfs.xfs /dev/sdc

or

mkfs.btrfs /dev/sdb
mkfs.btrfs /dev/sdc

it works

but after, when I type: /etc/fstab, I still have the error message : bash: /etc/fstab: Permission denied.

I tried to see the problem but so far I have not found a solution and I'm stuck.
If somebody can help me with pleasure.

thank you
 
but after, when I type: /etc/fstab, I still have the error message : bash: /etc/fstab: Permission denied.

Which is correct - you can't execute /ect/fstab.

I guess you want to edit /etc/fstab instead? Try

# vi /etc/fstab

or

# nano /etc/fstab
 
Thank you Dietmer

I kept the heads, but now I have another error message with the command :

mkcephfs -a -c /etc/ceph/ceph.conf -k ceph.keyring

and the message is :
temp dir is /tmp/mkcephfs.hkyvz2Cble
preparing monmap in /tmp/mkcephfs.hkyvz2Cble/monmap
/usr/bin/monmaptool --create --clobber --add a 192.168.100.21:6789 --add b 192.168.100.22:6789 --add c 192.168.100.23:6789 --print /tmp/mkcephfs.hkyvz2Cble/monmap
/usr/bin/monmaptool: monmap file /tmp/mkcephfs.hkyvz2Cble/monmap
/usr/bin/monmaptool: generated fsid 48cd177f-e488-4c3d-a5d3-6918e4dac093
epoch 0
fsid 48cd177f-e488-4c3d-a5d3-6918e4dac093
last_changed 2012-07-23 16:23:20.506286
created 2012-07-23 16:23:20.506286
0: 192.168.100.21:6789/0 mon.a
1: 192.168.100.22:6789/0 mon.b
2: 192.168.100.23:6789/0 mon.c
/usr/bin/monmaptool: writing epoch 0 to /tmp/mkcephfs.hkyvz2Cble/monmap (3 monitors)
=== osd.0 ===
2012-07-23 16:23:20.774728 7fbe2d50d780 -1 OSD::mkfs: FileStore::mkfs failed with error -2
2012-07-23 16:23:20.774797 7fbe2d50d780 -1 ** ERROR: error creating empty object store in /srv/osd.0: (2) No such file or directory
failed: '/sbin/mkcephfs -d /tmp/mkcephfs.hkyvz2Cble --init-daemon osd.0'

I have the same message with brtfs or xfs filesystem.

Thank you.
 
Code:
/srv/osd.0: (2) No such file or directory

you need to create these directories manually.
 
Thank you Tom,

But the directory /srv/osd.0 already exists

# mkdir /srv/osd.0
mkdir: impossible de créer le répertoire «/srv/osd.0»: Le fichier existe

thank's
 
I suggest you also try to get help via the ceph community.
 
Tom thank you for your help.
I just want to tell you that creates part of the file since he wrote in / srv/osd.0

when I go to the directory / srv/osd.0
ls shows me:
current fsid store_version

or why should the command does not run completely?

thank you
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!