KVM and sheepdog

[webfrank]

Hi, I would like to know how to test sheepdog storage for KVM. I installed a two node test storage cluster with sheepdog 0.4 and know I would like to create a KVM on my two node Proxmox cluster. I think I should change by hand vmid.conf as web interface is not ready for sheepdog but what should I have to write?
Something like this would be correct:

...
virtio0: sheepdog:vm-xxx-disk-1
...

I also think have to install pve-sheepdog package but I don't want at this moment to have Proxmox be part of sheepdog cluster.

Any help is appreciated

 

[tom]

sheepdog is not stable. use it only for testing and be prepared for data loss. a short search regarding your question shows this hint:
___
We could also install sheepdog on external servers.
(We can onl specify 1 ip, so it need to add a virtual ip to the corosync cluster if sheepdog is not on the kvm host)

configuration
--------------

/etc/pve/storage.cfg
sheepdog: sheepdogtest
portal 10.6.0.100:7000
content images

sheepdog: sheepdoglocal
portal 127.0.0.1:7000
content images
__

 

[webfrank]

Tnx Tom.
What I've done:
- install pve-sheepdog on the two node proxmox cluster
- discovered that the protocol to access my sheepdog cluster is not supported (I'll post more info)
- decided to start sheepdog inside proxmox creating dir /var/lib/sheepdog/disc0 and inside touch startup
- start daemon /etc/init.d/sheepdog (should be renamed pve-sheepdog as stated in /etc/default/sheepdog ?)
- format cluster with collie cluster format -c 2
- configure storage like Tom example
After these steps I was able to create and migrate KVM VM seamless. Only write performance are poor, 15MB/s.

 

[spirit]

I'll add a wiki page soon.

Performance seem low, I have benched 40.000 iops with ssd drives and 8000iops with sas drives?

 

[spirit]

do you have mounted a dedicated disk in /var/lib/sheepdog/disc0 ?
and what is your filesystem for this disk ?

 

[webfrank]

Hi, no, I used the standard LV pve-root for this test. Is it possible to configure where sheepdog storage should be put?

 

[spirit]

no, but you can mount a disk in /var/lib/sheepdog/disc0.
(I can recommand you xfs as filesystem).

If you use default pve-root, you need to add user_xattr option for ext3
/dev/pve/root / ext3 errors=remount-ro,user_xattr 0 1

 

[webfrank]

One more problem raised today, backup. vzdump reported:
INFO: Starting Backup of VM 123 (qemu)
INFO: status = running
ERROR: Backup of VM 123 failed - no such volume 'SD:vm-123-disk-1'
INFO: Backup job finished with errors

where SD is a sheepdog storage

 

[spirit]

backup is not implemented yet for sheepdog and rbd

 

[webfrank]

With sheepdog snapshots should be similar to lvm, isn't it? Where is backup code to have a look at it?

 

[dietmar]

With sheepdog snapshots should be similar to lvm, isn't it? Where is backup code to have a look at it?

see http://pve.proxmox.com/wiki/Developer_Documentation