Sheepdog does not start anymore after proxmox-2.3 to 3.0 upgrade

[Patrice Levesque]

Hi. Upgraded Proxmox on three nodes, each of them hosting 2 dedicated SSD drives for sheepdog; xfs-mounted on /var/lib/sheepdog/disc{0,1}.

The initial setup under proxmox-2.3 was done on each node and clustering worked, then.

Now, after upgrade to 3.0, sheepdog won't start, and complains:
Aug 19 01:57:18 [main] init_obj_path(245) /var/lib/sheepdog/disc0 is meta-store, abort

I checked in the code and this error message is spawned because there are 'epoch' and 'config' files in the /var/lib/sheepdog/disc{0,1} directories.

A ls -l /var/lib/sheepdog/disc0 shows (disc1 is similar):

-rw-r----- 1 root root 40 May 7 12:17 config
drwxr-x--- 2 root root 4096 Aug 18 19:00 epoch
drwxr-x--- 2 root root 6 May 7 12:17 journal
-rw-r----- 1 root root 0 May 7 12:15 lock
drwxr-x--- 4 root root 557056 Aug 18 19:13 obj
-rw-r--r-- 1 root root 4770639 Aug 18 19:15 sheep.log
srwxr-xr-x 1 root root 0 May 12 22:27 sock
-rw-r--r-- 1 root root 0 May 7 12:14 startup

These files were created by sheepdog itself, so it seems mixed up in its own mess.

Now, what should I do? should I remove everything but the obj directory and try again? What can I do to safely recover this cluster?

Thanks,

 

[spirit]

Hi,
sheepdog format has changed in sheepdog 0.6. (I think it shouldn't anymore change in the future)
(http://pve.proxmox.com/wiki/Storage:_Sheepdog)

meta-data should be now in /var/lib/sheepdog/ , and datas for each disc in /var/lib/sheepdog/discX.

Or if you have only 1disc, you can simply move all files to /var/lib/sheepdog

more infos for upgrade on sheepdog wiki:

https://github.com/sheepdog/sheepdog/wiki/Multi-disk-on-Single-Node-Support

 

[nasim]

sheepdog is installed successfully but it's not started.
I have tried to start it manualy with following command:
/etc/init.d/sheepdog start
and also tried
service sheepdog start
both are failed.
I have installed proxmox 3.1 over debian-70-wheezy-64-minimal.

 

[spirit]

sheepdog is installed successfully but it's not started.
I have tried to start it manualy with following command:
/etc/init.d/sheepdog start
and also tried
service sheepdog start
both are failed.
I have installed proxmox 3.1 over debian-70-wheezy-64-minimal.

Is it a new install or an upgrade ?
do you have an error message ?

 

[nasim]

It's a new install.
Now sheepdog is started but there is no file like /etc/pve/storage.cfg
Is there any changes to configure sheepdog running with proxmox 3.1
thanks

 

[dietmar]

Now sheepdog is started but there is no file like /etc/pve/storage.cfg

simply create the file.

 

[nasim]

Sir,
How to get the cluster name
On the sheepdog wiki the configuration is:
edit your /etc/pve/storage.cfg and add the configuration (gui creation is not available yet)
sheepdog: mysheepdogclustername
portal 127.0.0.1:7000
content images

 

[dietmar]

How to get the cluster name

AFAIK that is an arbitrary name - just choose one.

 

[nasim]

Thank you Dietmar