- Apr 15 13:00:01 storage-1 systemd: Created slice user-0.slice.
- Apr 15 13:00:01 storage-1 systemd: Starting Session 207 of user root.
- Apr 15 13:00:01 storage-1 systemd: Started Session 207 of user root.
- Apr 15 13:01:01 storage-1 systemd: Created slice user-0.slice.
- Apr 15 13:01:01 storage-1 systemd: Starting Session 208 of user root.
- Apr 15 13:01:01 storage-1 systemd: Started Session 208 of user root.
- Apr 15 13:01:34 storage-1 bash: msg/simple/Pipe.cc: In function 'int Pipe::connect()' thread 7f7ef6950700 time 2015-04-15 13:01:34.091353
- Apr 15 13:01:34 storage-1 bash: msg/simple/Pipe.cc: 1156: FAILED assert(m)
- Apr 15 13:01:34 storage-1 bash: ceph version 0.93 (bebf8e9a830d998eeaab55f86bb256d4360dd3c4)
- Apr 15 13:01:34 storage-1 bash: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7ee425]
- Apr 15 13:01:34 storage-1 bash: 2: (Pipe::connect()+0x399f) [0x967c4f]
- Apr 15 13:01:34 storage-1 bash: 3: (Pipe::writer()+0x4f1) [0x969191]
- Apr 15 13:01:34 storage-1 bash: 4: (Pipe::Writer::entry()+0xd) [0x9743cd]
- Apr 15 13:01:34 storage-1 bash: 5: (()+0x7df3) [0x7f7eff822df3]
- Apr 15 13:01:34 storage-1 bash: 6: (clone()+0x6d) [0x7f7efe3051ad]
- Apr 15 13:01:34 storage-1 bash: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- Apr 15 13:01:34 storage-1 bash: 2015-04-15 13:01:34.104158 7f7ef6950700 -1 msg/simple/Pipe.cc: In function 'int Pipe::connect()' thread 7f7ef6950700 time 2015-04-15 13:01:34.091353
- Apr 15 13:01:34 storage-1 bash: msg/simple/Pipe.cc: 1156: FAILED assert(m)
- Apr 15 13:01:34 storage-1 bash: ceph version 0.93 (bebf8e9a830d998eeaab55f86bb256d4360dd3c4)
- Apr 15 13:01:34 storage-1 bash: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7ee425]
- Apr 15 13:01:34 storage-1 bash: 2: (Pipe::connect()+0x399f) [0x967c4f]
- Apr 15 13:01:34 storage-1 bash: 3: (Pipe::writer()+0x4f1) [0x969191]
- Apr 15 13:01:34 storage-1 bash: 4: (Pipe::Writer::entry()+0xd) [0x9743cd]
- Apr 15 13:01:34 storage-1 bash: 5: (()+0x7df3) [0x7f7eff822df3]
- Apr 15 13:01:34 storage-1 bash: 6: (clone()+0x6d) [0x7f7efe3051ad]
- Apr 15 13:01:34 storage-1 bash: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- Apr 15 13:01:34 storage-1 bash: 0> 2015-04-15 13:01:34.104158 7f7ef6950700 -1 msg/simple/Pipe.cc: In function 'int Pipe::connect()' thread 7f7ef6950700 time 2015-04-15 13:01:34.091353
- Apr 15 13:01:34 storage-1 bash: msg/simple/Pipe.cc: 1156: FAILED assert(m)
- Apr 15 13:01:34 storage-1 bash: ceph version 0.93 (bebf8e9a830d998eeaab55f86bb256d4360dd3c4)
- Apr 15 13:01:34 storage-1 bash: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7ee425]
- Apr 15 13:01:34 storage-1 bash: 2: (Pipe::connect()+0x399f) [0x967c4f]
- Apr 15 13:01:34 storage-1 bash: 3: (Pipe::writer()+0x4f1) [0x969191]
- Apr 15 13:01:34 storage-1 bash: 4: (Pipe::Writer::entry()+0xd) [0x9743cd]
- Apr 15 13:01:34 storage-1 bash: 5: (()+0x7df3) [0x7f7eff822df3]
- Apr 15 13:01:34 storage-1 bash: 6: (clone()+0x6d) [0x7f7efe3051ad]
- Apr 15 13:01:34 storage-1 bash: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- Apr 15 13:01:34 storage-1 bash: terminate called after throwing an instance of 'ceph::FailedAssertion'
- Apr 15 13:01:34 storage-1 bash: *** Caught signal (Aborted) **
- Apr 15 13:01:34 storage-1 bash: in thread 7f7ef6950700
- Apr 15 13:01:34 storage-1 bash: ceph version 0.93 (bebf8e9a830d998eeaab55f86bb256d4360dd3c4)
- Apr 15 13:01:34 storage-1 bash: 1: /usr/bin/ceph-mon() [0x9c7092]
- Apr 15 13:01:34 storage-1 bash: 2: (()+0xf130) [0x7f7eff82a130]
- Apr 15 13:01:34 storage-1 bash: 3: (gsignal()+0x39) [0x7f7efe2445c9]
- Apr 15 13:01:34 storage-1 bash: 4: (abort()+0x148) [0x7f7efe245cd8]
- Apr 15 13:01:34 storage-1 bash: 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f7efeb489d5]
- Apr 15 13:01:34 storage-1 bash: 6: (()+0x5e946) [0x7f7efeb46946]
- Apr 15 13:01:34 storage-1 bash: 7: (()+0x5e973) [0x7f7efeb46973]
- Apr 15 13:01:34 storage-1 bash: 8: (()+0x5eb9f) [0x7f7efeb46b9f]
- Apr 15 13:01:34 storage-1 bash: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0x7ee61a]
- Apr 15 13:01:34 storage-1 bash: 10: (Pipe::connect()+0x399f) [0x967c4f]
- Apr 15 13:01:34 storage-1 bash: 11: (Pipe::writer()+0x4f1) [0x969191]
- Apr 15 13:01:34 storage-1 bash: 12: (Pipe::Writer::entry()+0xd) [0x9743cd]
- Apr 15 13:01:34 storage-1 bash: 13: (()+0x7df3) [0x7f7eff822df3]
- Apr 15 13:01:34 storage-1 bash: 14: (clone()+0x6d) [0x7f7efe3051ad]
- Apr 15 13:01:34 storage-1 bash: 2015-04-15 13:01:34.146919 7f7ef6950700 -1 *** Caught signal (Aborted) **
- Apr 15 13:01:34 storage-1 bash: in thread 7f7ef6950700
- Apr 15 13:01:34 storage-1 bash: ceph version 0.93 (bebf8e9a830d998eeaab55f86bb256d4360dd3c4)
- Apr 15 13:01:34 storage-1 bash: 1: /usr/bin/ceph-mon() [0x9c7092]
- Apr 15 13:01:34 storage-1 bash: 2: (()+0xf130) [0x7f7eff82a130]
- Apr 15 13:01:34 storage-1 bash: 3: (gsignal()+0x39) [0x7f7efe2445c9]
- Apr 15 13:01:34 storage-1 bash: 4: (abort()+0x148) [0x7f7efe245cd8]
- Apr 15 13:01:34 storage-1 bash: 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f7efeb489d5]
- Apr 15 13:01:34 storage-1 bash: 6: (()+0x5e946) [0x7f7efeb46946]
- Apr 15 13:01:34 storage-1 bash: 7: (()+0x5e973) [0x7f7efeb46973]
- Apr 15 13:01:34 storage-1 bash: 8: (()+0x5eb9f) [0x7f7efeb46b9f]
- Apr 15 13:01:34 storage-1 bash: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0x7ee61a]
- Apr 15 13:01:34 storage-1 bash: 10: (Pipe::connect()+0x399f) [0x967c4f]
- Apr 15 13:01:34 storage-1 bash: 11: (Pipe::writer()+0x4f1) [0x969191]
- Apr 15 13:01:34 storage-1 bash: 12: (Pipe::Writer::entry()+0xd) [0x9743cd]
- Apr 15 13:01:34 storage-1 bash: 13: (()+0x7df3) [0x7f7eff822df3]
- Apr 15 13:01:34 storage-1 bash: 14: (clone()+0x6d) [0x7f7efe3051ad]
- Apr 15 13:01:34 storage-1 bash: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- Apr 15 13:01:34 storage-1 bash: 0> 2015-04-15 13:01:34.146919 7f7ef6950700 -1 *** Caught signal (Aborted) **
- Apr 15 13:01:34 storage-1 bash: in thread 7f7ef6950700
- Apr 15 13:01:34 storage-1 bash: ceph version 0.93 (bebf8e9a830d998eeaab55f86bb256d4360dd3c4)
- Apr 15 13:01:34 storage-1 bash: 1: /usr/bin/ceph-mon() [0x9c7092]
- Apr 15 13:01:34 storage-1 bash: 2: (()+0xf130) [0x7f7eff82a130]
- Apr 15 13:01:34 storage-1 bash: 3: (gsignal()+0x39) [0x7f7efe2445c9]
- Apr 15 13:01:34 storage-1 bash: 4: (abort()+0x148) [0x7f7efe245cd8]
- Apr 15 13:01:34 storage-1 bash: 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f7efeb489d5]
- Apr 15 13:01:34 storage-1 bash: 6: (()+0x5e946) [0x7f7efeb46946]
- Apr 15 13:01:34 storage-1 bash: 7: (()+0x5e973) [0x7f7efeb46973]
- Apr 15 13:01:34 storage-1 bash: 8: (()+0x5eb9f) [0x7f7efeb46b9f]
- Apr 15 13:01:34 storage-1 bash: 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0x7ee61a]
- Apr 15 13:01:34 storage-1 bash: 10: (Pipe::connect()+0x399f) [0x967c4f]
- Apr 15 13:01:34 storage-1 bash: 11: (Pipe::writer()+0x4f1) [0x969191]
- Apr 15 13:01:34 storage-1 bash: 12: (Pipe::Writer::entry()+0xd) [0x9743cd]
- Apr 15 13:01:34 storage-1 bash: 13: (()+0x7df3) [0x7f7eff822df3]
- Apr 15 13:01:34 storage-1 bash: 14: (clone()+0x6d) [0x7f7efe3051ad]
- Apr 15 13:01:34 storage-1 bash: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- Apr 15 13:01:34 storage-1 bash: /usr/bin/bash: line 1: 12596 Aborted /usr/bin/ceph-mon -i storage-1 --pid-file /var/run/ceph/mon.storage-1.pid -c /etc/ceph/ceph.conf --cluster ceph -f
- Apr 15 13:01:34 storage-1 systemd: run-12582.service: main process exited, code=exited, status=134/n/a
- Apr 15 13:01:40 storage-1 kernel: rx_data returned 0, expecting 48.
- Apr 15 13:01:40 storage-1 kernel: iSCSI Login negotiation failed.
- Apr 15 13:02:01 storage-1 kernel: rx_data returned 0, expecting 48.
- Apr 15 13:02:01 storage-1 kernel: iSCSI Login negotiation failed.
- Apr 15 13:02:28 storage-1 kernel: libceph: mon2 10.100.0.7:6789 socket closed (con state OPEN)
- Apr 15 13:02:28 storage-1 kernel: libceph: mon2 10.100.0.7:6789 session lost, hunting for new mon
- Apr 15 13:02:28 storage-1 kernel: libceph: mon0 10.100.0.1:6789 socket error on write
- Apr 15 13:02:40 storage-1 kernel: rx_data returned 0, expecting 48.
- Apr 15 13:02:40 storage-1 kernel: iSCSI Login negotiation failed.
- Apr 15 13:02:48 storage-1 kernel: libceph: mon0 10.100.0.1:6789 socket error on write
- Apr 15 13:02:58 storage-1 kernel: libceph: mon0 10.100.0.1:6789 socket error on write