Proxmox 5 and ceph luminous: can't create monitor

G

gosha

Well-Known Member
Oct 20, 2014
302
25
58
Russia
Hi!

I decided to try Proxmox 5. And play around ceph luminous.
After installation Proxmox 5 (via debian install) and ceph via pveceph install --version luminous
and after pveceph init --network I tried to create a monitor and get error:

Code: 
# pveceph createmon
creating /etc/pve/priv/ceph.client.admin.keyring
monmaptool: monmap file /tmp/monmap
monmaptool: generated fsid e31cef43-c48b-4262-9dd5-7eae1c7fb8bb
epoch 0
fsid e31cef43-c48b-4262-9dd5-7eae1c7fb8bb
last_changed 2017-07-05 14:49:56.086645
created 2017-07-05 14:49:56.086645
0: 192.168.110.5:6789/0 mon.0
monmaptool: writing epoch 0 to /tmp/monmap (1 monitors)
ceph-mon: set fsid to 1f91809b-6590-410d-b252-3983fe8126d5
*** Caught signal (Illegal instruction) **
 in thread 7f49bafe8c80 thread_name:ceph-mon
 ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
 1: (()+0x82bcc2) [0x55ddd3d32cc2]
 2: (()+0x110c0) [0x7f49ba3a00c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x55ddd3ef3cc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x55ddd3ddb14c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x55ddd3da231f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x55ddd3da3d90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x55ddd3da55f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x55ddd393c00e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x55ddd393d5c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x55ddd381dc83]
 11: (main()+0x7ef) [0x55ddd378c4af]
 12: (__libc_start_main()+0xf1) [0x7f49b77b42b1]
 13: (_start()+0x2a) [0x55ddd381adba]
2017-07-05 14:49:56.271855 7f49bafe8c80 -1 *** Caught signal (Illegal instruction) **
 in thread 7f49bafe8c80 thread_name:ceph-mon

 ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
 1: (()+0x82bcc2) [0x55ddd3d32cc2]
 2: (()+0x110c0) [0x7f49ba3a00c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x55ddd3ef3cc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x55ddd3ddb14c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x55ddd3da231f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x55ddd3da3d90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x55ddd3da55f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x55ddd393c00e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x55ddd393d5c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x55ddd381dc83]
 11: (main()+0x7ef) [0x55ddd378c4af]
 12: (__libc_start_main()+0xf1) [0x7f49b77b42b1]
 13: (_start()+0x2a) [0x55ddd381adba]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

     0> 2017-07-05 14:49:56.271855 7f49bafe8c80 -1 *** Caught signal (Illegal instruction) **
 in thread 7f49bafe8c80 thread_name:ceph-mon

 ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
 1: (()+0x82bcc2) [0x55ddd3d32cc2]
 2: (()+0x110c0) [0x7f49ba3a00c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x55ddd3ef3cc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x55ddd3ddb14c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x55ddd3da231f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x55ddd3da3d90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x55ddd3da55f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x55ddd393c00e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x55ddd393d5c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x55ddd381dc83]
 11: (main()+0x7ef) [0x55ddd378c4af]
 12: (__libc_start_main()+0xf1) [0x7f49b77b42b1]
 13: (_start()+0x2a) [0x55ddd381adba]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

command 'ceph-mon --mkfs -i 0 --monmap /tmp/monmap --keyring /etc/pve/priv/ceph.mon.keyring' failed: got signal 4

What to do?

Best regards,
Gosha
 
Hi,

can you please send the output of

pveversion -v
 
wolfgang said:
Hi,

can you please send the output of

pveversion -v
Click to expand...


proxmox-ve: 5.0-15 (running kernel: 4.10.15-1-pve)
pve-manager: 5.0-23 (running version: 5.0-23/af4267bf)
pve-kernel-4.10.15-1-pve: 4.10.15-15
libpve-http-server-perl: 2.0-5
lvm2: 2.02.168-pve2
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-10
qemu-server: 5.0-12
pve-firmware: 2.0-2
libpve-common-perl: 5.0-16
libpve-guest-common-perl: 2.0-11
libpve-access-control: 5.0-5
libpve-storage-perl: 5.0-12
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-2
pve-docs: 5.0-6
pve-qemu-kvm: 2.9.0-2
pve-container: 2.0-14
pve-firewall: 3.0-1
pve-ha-manager: 2.0-2
ksm-control-daemon: not correctly installed
glusterfs-client: 3.8.8-1
lxc-pve: 2.0.8-3
lxcfs: 2.0.7-pve2
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
ceph: 12.1.0-pve2
 
What do you use as storage?
And which HW do you use?
 
Last edited:
I assume this is a test server and not for production?

If yes can you try the ceph debian packages to check if this is opteron problem or if this is a compile problem.

http://docs.ceph.com/docs/master/install/get-packages/

We do not have any Opteron CPU here test and on Intel CPU it work without problems.
 
wolfgang said:
I assume this is a test server and not for production?

If yes can you try the ceph debian packages to check if this is opteron problem or if this is a compile problem.

http://docs.ceph.com/docs/master/install/get-packages/

We do not have any Opteron CPU here test and on Intel CPU it work without problems.
Click to expand...


Yes of course! This old server for testing needs only. (But I'm trying to adapt it for third copies of backups... Just in case... ;) )
I'll try debian packages later and report the results.

Best regards,
Gosha
 
Last edited:
wolfgang said:
I assume this is a test server and not for production?

If yes can you try the ceph debian packages to check if this is opteron problem or if this is a compile problem.

http://docs.ceph.com/docs/master/install/get-packages/

We do not have any Opteron CPU here test and on Intel CPU it work without problems.
Click to expand...


Ok. I installed ceph from deb https://download.ceph.com/debian-luminous/ stretch main
and after 'pveceph init --network ...' I tried 'pveceph createmon' again.
And get the same error:

Code: 
pveceph createmon
creating /etc/pve/priv/ceph.client.admin.keyring
monmaptool: monmap file /tmp/monmap
monmaptool: generated fsid 5d603e48-432c-4b58-8b17-461ecd20018d
epoch 0
fsid 5d603e48-432c-4b58-8b17-461ecd20018d
last_changed 2017-07-05 21:40:15.972493
created 2017-07-05 21:40:15.972493
0: 192.168.110.5:6789/0 mon.0
monmaptool: writing epoch 0 to /tmp/monmap (1 monitors)
ceph-mon: set fsid to 7dde6305-0fc1-4ada-99a9-68617f02baad
*** Caught signal (Illegal instruction) **
 in thread 7f2264e3fc80 thread_name:ceph-mon
 ceph version 12.1.0 (262617c9f16c55e863693258061c5b25dea5b086) luminous (dev)
 1: (()+0x82bcc2) [0x5567dbad3cc2]
 2: (()+0x110c0) [0x7f22641f70c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x5567dbc94cc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x5567dbb7c14c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x5567dbb4331f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x5567dbb44d90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x5567dbb465f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x5567db6dd00e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x5567db6de5c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x5567db5bec83]
 11: (main()+0x7ef) [0x5567db52d4af]
 12: (__libc_start_main()+0xf1) [0x7f226160b2b1]
 13: (_start()+0x2a) [0x5567db5bbdba]
2017-07-05 21:40:16.355087 7f2264e3fc80 -1 *** Caught signal (Illegal instruction) **
 in thread 7f2264e3fc80 thread_name:ceph-mon

 ceph version 12.1.0 (262617c9f16c55e863693258061c5b25dea5b086) luminous (dev)
 1: (()+0x82bcc2) [0x5567dbad3cc2]
 2: (()+0x110c0) [0x7f22641f70c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x5567dbc94cc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x5567dbb7c14c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x5567dbb4331f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x5567dbb44d90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x5567dbb465f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x5567db6dd00e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x5567db6de5c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x5567db5bec83]
 11: (main()+0x7ef) [0x5567db52d4af]
 12: (__libc_start_main()+0xf1) [0x7f226160b2b1]
 13: (_start()+0x2a) [0x5567db5bbdba]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

     0> 2017-07-05 21:40:16.355087 7f2264e3fc80 -1 *** Caught signal (Illegal instruction) **
 in thread 7f2264e3fc80 thread_name:ceph-mon

 ceph version 12.1.0 (262617c9f16c55e863693258061c5b25dea5b086) luminous (dev)
 1: (()+0x82bcc2) [0x5567dbad3cc2]
 2: (()+0x110c0) [0x7f22641f70c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x5567dbc94cc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x5567dbb7c14c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x5567dbb4331f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x5567dbb44d90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x5567dbb465f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x5567db6dd00e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x5567db6de5c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x5567db5bec83]
 11: (main()+0x7ef) [0x5567db52d4af]
 12: (__libc_start_main()+0xf1) [0x7f226160b2b1]
 13: (_start()+0x2a) [0x5567db5bbdba]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

command 'ceph-mon --mkfs -i 0 --monmap /tmp/monmap --keyring /etc/pve/priv/ceph.mon.keyring' failed: got signal 4

This is the problem of Optheron? :(
 
And I can't install Jewel via:
pveceph install --version jewel

In Proxmox 5 I can't install a stable version of ceph? I'm very sad :(
 
Same here. I opened a ticket at Ceph's Bug Tracker.

But it could really be a problem that there is no stable Ceph release available for PVE 5.0, especially if someone could run into this issue after upgrading from 4.4, expecting a stable release.
 
  • Like
Reactions: Lky
What is your setting in /etc/default/ceph?
I have seen issues on my Opteron systems when using jemalloc. I'd avise trying without it just to be sure.
 
Last edited:
Waschbüsch said:
What is your setting in /etc/default/ceph?
I have seen issues on my Opteron systems when using jemalloc. I'd avise trying without it just to be sure.
Click to expand...

Code: 
# /etc/default/ceph
#
# Environment file for ceph daemon systemd unit files.
#

# Increase tcmalloc cache size
TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES=134217728

## use jemalloc instead of tcmalloc
#
# jemalloc is generally faster for small IO workloads and when
# ceph-osd is backed by SSDs.  However, memory usage is usually
# higher by 200-300mb.
#
#LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libjemalloc.so.1
 
wolfgang said:
Can you please tell us the type of the Xeon?
Click to expand...
Code: 
CPU(s): 8 x Intel(R) Xeon(R) CPU X5355 @ 2.66GHz (2 Sockets)
Kernel Version: Linux 4.10.15-1-pve #1 SMP PVE 4.10.15-15 (Fri, 23 Jun 2017 08:57:55 +0200)
PVE Manager Version: pve-manager/5.0-23/af4267bf

Code: 
pveceph createmon
ceph-mon: set fsid to 6c591d05-f965-456a-9082-b1ecd0e6cada
*** Caught signal (Illegal instruction) **
 in thread 7f16dc49fc80 thread_name:ceph-mon
 ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
 1: (()+0x82bcc2) [0x557bb9b76cc2]
 2: (()+0x110c0) [0x7f16db8580c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x557bb9d37cc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x557bb9c1f14c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x557bb9be631f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x557bb9be7d90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x557bb9be95f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x557bb978000e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x557bb97815c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x557bb9661c83]
 11: (main()+0x7ef) [0x557bb95d04af]
 12: (__libc_start_main()+0xf1) [0x7f16d8c6c2b1]
 13: (_start()+0x2a) [0x557bb965edba]
2017-07-10 08:31:07.420219 7f16dc49fc80 -1 *** Caught signal (Illegal instruction) **
 in thread 7f16dc49fc80 thread_name:ceph-mon

 ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
 1: (()+0x82bcc2) [0x557bb9b76cc2]
 2: (()+0x110c0) [0x7f16db8580c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x557bb9d37cc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x557bb9c1f14c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x557bb9be631f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x557bb9be7d90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x557bb9be95f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x557bb978000e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x557bb97815c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x557bb9661c83]
 11: (main()+0x7ef) [0x557bb95d04af]
 12: (__libc_start_main()+0xf1) [0x7f16d8c6c2b1]
 13: (_start()+0x2a) [0x557bb965edba]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

     0> 2017-07-10 08:31:07.420219 7f16dc49fc80 -1 *** Caught signal (Illegal instruction) **
 in thread 7f16dc49fc80 thread_name:ceph-mon

 ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
 1: (()+0x82bcc2) [0x557bb9b76cc2]
 2: (()+0x110c0) [0x7f16db8580c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x557bb9d37cc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x557bb9c1f14c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x557bb9be631f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x557bb9be7d90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x557bb9be95f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x557bb978000e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x557bb97815c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x557bb9661c83]
 11: (main()+0x7ef) [0x557bb95d04af]
 12: (__libc_start_main()+0xf1) [0x7f16d8c6c2b1]
 13: (_start()+0x2a) [0x557bb965edba]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

command 'ceph-mon --mkfs -i 2 --monmap /tmp/monmap --keyring /etc/pve/priv/ceph.mon.keyring' failed: got signal 4
 
can reproduce on old xeon (Intel(R) Xeon(R) CPU 5110 @ 1.60GHz)

Code: 
ceph-mon: set fsid to 967014e1-48ac-464e-8ccf-cfe732d052c7
*** Caught signal (Illegal instruction) **
 in thread 7f79283e5c80 thread_name:ceph-mon
 ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
 1: (()+0x82bcc2) [0x561382899cc2]
 2: (()+0x110c0) [0x7f79277bb0c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x561382a5acc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x56138294214c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x56138290931f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x56138290ad90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x56138290c5f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x5613824a300e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x5613824a45c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x561382384c83]
 11: (main()+0x7ef) [0x5613822f34af]
 12: (__libc_start_main()+0xf1) [0x7f7924bcf2b1]
 13: (_start()+0x2a) [0x561382381dba]
2017-07-11 00:04:02.167698 7f79283e5c80 -1 *** Caught signal (Illegal instruction) **
 in thread 7f79283e5c80 thread_name:ceph-mon

 ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
 1: (()+0x82bcc2) [0x561382899cc2]
 2: (()+0x110c0) [0x7f79277bb0c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x561382a5acc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x56138294214c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x56138290931f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x56138290ad90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x56138290c5f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x5613824a300e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x5613824a45c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x561382384c83]
 11: (main()+0x7ef) [0x5613822f34af]
 12: (__libc_start_main()+0xf1) [0x7f7924bcf2b1]
 13: (_start()+0x2a) [0x561382381dba]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

     0> 2017-07-11 00:04:02.167698 7f79283e5c80 -1 *** Caught signal (Illegal instruction) **
 in thread 7f79283e5c80 thread_name:ceph-mon

 ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
 1: (()+0x82bcc2) [0x561382899cc2]
 2: (()+0x110c0) [0x7f79277bb0c0]
 3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x561382a5acc1]
 4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x56138294214c]
 5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x56138290931f]
 6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x56138290ad90]
 7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x56138290c5f8]
 8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x5613824a300e]
 9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x5613824a45c7]
 10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x561382384c83]
 11: (main()+0x7ef) [0x5613822f34af]
 12: (__libc_start_main()+0xf1) [0x7f7924bcf2b1]
 13: (_start()+0x2a) [0x561382381dba]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
 
CPU(s)2 x AMD Turion(tm) II Neo N54L Dual-Core Processor (1 Socket) have same bug.
 
  • Like
Reactions: bnags
Please to all on this thread report which can reproduce this error.
Report to the bug record on ceph which Dennis opened.

http://tracker.ceph.com/issues/20529

The ceph guys need help to debug this.

I would do but we have no HW where we can reproduce it.
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back