[SOLVED] sheepdog storage only available on some pve nodes

[anthonysomerset]

i have a 5 node cluster (not HA yet) thats slowly growing

i've been looking at shared storage without requiring SAN's and am all but settled on sheepdog as an option

2 of my servers are not really adequate for running sheepdog so i want to avoid installing on those nodes and not allow booting of sheepdog based VM's on those servers or creation for that matter

because i currently have to add sheepdog storage direct into /etc/pve/storage.cfg - how do I only allow it to be available on specific nodes as you can do in the GUI when adding normal storage?

initially i'm wanting to do some real world tests with a proper cluster (i don't have enough test devices in the lab) so true HA isn't critical at this stage as i wont be testing failover aspects, just performance and reliability

 

[spirit]

Re: sheepdog storage only available on some pve nodes

i have a 5 node cluster (not HA yet) thats slowly growing

i've been looking at shared storage without requiring SAN's and am all but settled on sheepdog as an option

2 of my servers are not really adequate for running sheepdog so i want to avoid installing on those nodes and not allow booting of sheepdog based VM's on those servers or creation for that matter

because i currently have to add sheepdog storage direct into /etc/pve/storage.cfg - how do I only allow it to be available on specific nodes as you can do in the GUI when adding normal storage?

initially i'm wanting to do some real world tests with a proper cluster (i don't have enough test devices in the lab) so true HA isn't critical at this stage as i wont be testing failover aspects, just performance and reliability

like for others storage, you can add option:

sheepdog: sheepdogstorage
               nodes server1,server2,server3...

 

[anthonysomerset]

Re: sheepdog storage only available on some pve nodes

perfect thanks

i can live migrate with it nicely

only thing to note is that i couldnt migrate storage to it without first turning the VM off - i got the following error if i tried with the node online:

TASK ERROR: storage migration failed: mirroring error: VM 108 qmp command 'block-job-complete' failed - The active block job for device 'drive-virtio0' cannot be completed

 

[anthonysomerset]

Re: sheepdog storage only available on some pve nodes

looks like this is due to updating qemu and not rebooting instances first rather than any issue