LXC containers with ceph Jewel

[oliv]

Hi,
I'm trying to make LXC containers work with ceph Jewel 10.2.3 (altough it's not yet officially supported...) and Proxmox 4.3 (kernel 4.4.21)
I added a ceph pool to store my containers images and proxmox use krbd to connect to it but when I create a container I get a rbd: sysfs write failed error. I've seen that this issue is usually due to the new default features introduced by jewel but this patch was made to disable them and when I check my non working image in ceph I can see that they are actually disabled.

# rbd info rbd/vm-106-disk-1
rbd image 'vm-106-disk-1':
size 8192 MB in 2048 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.4ae27d2ae8944a
format: 2
features: layering
flags:​

I can also see this in dmesg on the proxmox node

[ 77.408933] libceph: mon0 169.254.4.1:6789 feature set mismatch, my 106b84a842a42 < server's 40106b84a842a42, missing 400000000000000
[ 77.409005] libceph: mon0 169.254.4.1:6789 missing required protocol features​

Any idea of what might help in this case ?
Thx.

 

[fabian]

check your tunables - CRUSH_TUNABLES5 introduced with jewel is not yet supported by the 4.4 kernel module

 

[oliv]

Whoa thanks for the fast asnwer
I actually got it working with ceph osd crush tunables hammer to disable CRUSH_TUNABLES5