log when re-add osd using ceph-osd

osd.6.log

2016-03-21 10:33:17.961553 7f0d0956c7c0  0 ceph version 0.80.7 (6c0127fcb58008793d3c8b62d925bc91963672a3), process ceph-osd, pid 4334
2016-03-21 10:33:17.963542 7f0d0956c7c0  1 filestore(/var/lib/ceph/osd/ceph-6) mkfs in /var/lib/ceph/osd/ceph-6
2016-03-21 10:33:17.963592 7f0d0956c7c0 -1 filestore(/var/lib/ceph/osd/ceph-6) mkfs on-disk fsid 509c0d73-9dc2-4983-92f5-097f940d19f3 != provided fd403120-f998-4c24-935a-6b475e4c24f4
2016-03-21 10:33:17.963728 7f0d0956c7c0 -1 OSD::mkfs: ObjectStore::mkfs failed with error -22
2016-03-21 10:33:17.963768 7f0d0956c7c0 -1 ESC[0;31m ** ERROR: error creating empty object store in /var/lib/ceph/osd/ceph-6: (22) Invalid argumentESC[0m
2016-03-21 10:33:44.093836 7fed3424a7c0  0 ceph version 0.80.7 (6c0127fcb58008793d3c8b62d925bc91963672a3), process ceph-osd, pid 4736
2016-03-21 10:33:44.095605 7fed3424a7c0  1 filestore(/var/lib/ceph/osd/ceph-6) mkfs in /var/lib/ceph/osd/ceph-6
2016-03-21 10:33:44.095632 7fed3424a7c0  1 filestore(/var/lib/ceph/osd/ceph-6) mkfs fsid is already set to 509c0d73-9dc2-4983-92f5-097f940d19f3
2016-03-21 10:33:44.332780 7fed3424a7c0  1 filestore(/var/lib/ceph/osd/ceph-6) leveldb db exists/created
2016-03-21 10:33:44.334945 7fed3424a7c0  1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 9: 10948182016 bytes, block size 4096 bytes, directio = 1, aio = 1
2016-03-21 10:33:44.335436 7fed3424a7c0  1 journal check: header looks ok
2016-03-21 10:33:44.335532 7fed3424a7c0  1 filestore(/var/lib/ceph/osd/ceph-6) mkfs done in /var/lib/ceph/osd/ceph-6
2016-03-21 10:33:44.335610 7fed3424a7c0  0 filestore(/var/lib/ceph/osd/ceph-6) mount detected xfs (libxfs)
2016-03-21 10:33:44.335616 7fed3424a7c0  1 filestore(/var/lib/ceph/osd/ceph-6)  disabling 'filestore replica fadvise' due to known issues with fadvise(DONTNEED) on xfs
2016-03-21 10:33:44.416691 7fed3424a7c0  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-6) detect_features: FIEMAP ioctl is supported and appears to work
2016-03-21 10:33:44.417705 7fed3424a7c0  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-6) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
2016-03-21 10:33:44.417766 7fed3424a7c0  0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-6) detect_feature: extsize is disabled by conf
2016-03-21 10:33:44.511711 7fed3424a7c0  0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
2016-03-21 10:33:44.517554 7fed3424a7c0  1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 16: 10948182016 bytes, block size 4096 bytes, directio = 1, aio = 1
2016-03-21 10:33:44.518286 7fed3424a7c0 -1 filestore(/var/lib/ceph/osd/ceph-6) could not find db4837f7/rbd_data.505c287ed5d9da.0000000000000cb5/head//5 in index: (2) No such file or directory
2016-03-21 10:33:44.518325 7fed3424a7c0 -1 filestore(/var/lib/ceph/osd/ceph-6) could not find b9bcb7f7/rbd_data.505c3d2e483d1b.0000000000000e42/head//5 in index: (2) No such file or directory
2016-03-21 10:33:44.518341 7fed3424a7c0 -1 filestore(/var/lib/ceph/osd/ceph-6) could not find 9cbbc7f7/rbd_data.97217d3e9c62.0000000000000214/head//5 in index: (2) No such file or directory
2016-03-21 10:33:44.518355 7fed3424a7c0 -1 filestore(/var/lib/ceph/osd/ceph-6) could not find 95b9f7f7/rbd_data.4e17ee7783cee9.000000000000108c/head//5 in index: (2) No such file or directory
2016-03-21 10:33:44.518370 7fed3424a7c0 -1 filestore(/var/lib/ceph/osd/ceph-6) could not find d5981ff7/rbd_data.505c3d2e483d1b.0000000000000f9b/head//5 in index: (2) No such file or directory
2016-03-21 10:33:44.518387 7fed3424a7c0 -1 filestore(/var/lib/ceph/osd/ceph-6) could not find 3a41aff7/rbd_data.4e1bc6160ebae0.00000000000008ae/head//5 in index: (2) No such file or directory
2016-03-21 10:33:45.332345 7fed3424a7c0  1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 16: 10948182016 bytes, block size 4096 bytes, directio = 1, aio = 1
2016-03-21 10:33:45.346383 7fed3424a7c0  0  have superblock
2016-03-21 10:33:45.346391 7fed3424a7c0 -1 provided osd id 6 != superblock's -1
2016-03-21 10:33:45.361447 7fed3424a7c0  1 journal close /var/lib/ceph/osd/ceph-6/journal
2016-03-21 10:33:45.366455 7fed3424a7c0 -1 ESC[0;31m ** ERROR: error creating empty object store in /var/lib/ceph/osd/ceph-6: (22) Invalid argumentESC[0m
2016-03-21 10:39:40.153422 7f7dd94d07c0  0 ceph version 0.80.7 (6c0127fcb58008793d3c8b62d925bc91963672a3), process ceph-osd, pid 13424
2016-03-21 10:39:40.156860 7f7dd94d07c0  0 filestore(/var/lib/ceph/osd/ceph-6) mount detected xfs (libxfs)
2016-03-21 10:39:40.156873 7f7dd94d07c0  1 filestore(/var/lib/ceph/osd/ceph-6)  disabling 'filestore replica fadvise' due to known issues with fadvise(DONTNEED) on xfs
2016-03-21 10:39:40.159459 7f7dd94d07c0  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-6) detect_features: FIEMAP ioctl is supported and appears to work
2016-03-21 10:39:40.160221 7f7dd94d07c0  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-6) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
2016-03-21 10:39:40.160276 7f7dd94d07c0  0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-6) detect_feature: extsize is disabled by conf
2016-03-21 10:39:40.164131 7f7dd94d07c0  0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
2016-03-21 10:39:40.169488 7f7dd94d07c0  1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 21: 10948182016 bytes, block size 4096 bytes, directio = 1, aio = 1
2016-03-21 10:39:40.173117 7f7dd94d07c0  1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 21: 10948182016 bytes, block size 4096 bytes, directio = 1, aio = 1
2016-03-21 10:39:40.173751 7f7dd94d07c0  1 journal close /var/lib/ceph/osd/ceph-6/journal
2016-03-21 10:39:40.179595 7f7dd94d07c0  0 filestore(/var/lib/ceph/osd/ceph-6) mount detected xfs (libxfs)
2016-03-21 10:39:40.187043 7f7dd94d07c0  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-6) detect_features: FIEMAP ioctl is supported and appears to work
2016-03-21 10:39:40.187732 7f7dd94d07c0  0 genericfilestorebackend(/var/lib/ceph/osd/ceph-6) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
2016-03-21 10:39:40.187781 7f7dd94d07c0  0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-6) detect_feature: extsize is disabled by conf
2016-03-21 10:39:40.202692 7f7dd94d07c0  0 filestore(/var/lib/ceph/osd/ceph-6) mount: WRITEAHEAD journal mode explicitly enabled in conf
2016-03-21 10:39:40.207373 7f7dd94d07c0  1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 22: 10948182016 bytes, block size 4096 bytes, directio = 1, aio = 1
2016-03-21 10:39:40.211653 7f7dd94d07c0  1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 22: 10948182016 bytes, block size 4096 bytes, directio = 1, aio = 1
2016-03-21 10:39:40.212198 7f7dd94d07c0  0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
2016-03-21 10:39:40.260220 7f7dd94d07c0  0 osd.6 41079 crush map has features 2200130813952, adjusting msgr requires for clients  
2016-03-21 10:39:40.260233 7f7dd94d07c0  0 osd.6 41079 crush map has features 2200130813952 was 8705, adjusting msgr requires for mons
2016-03-21 10:39:40.260238 7f7dd94d07c0  0 osd.6 41079 crush map has features 2200130813952, adjusting msgr requires for osds
2016-03-21 10:39:40.260249 7f7dd94d07c0  0 osd.6 41079 load_pgs
2016-03-21 10:40:02.880702 7f7dd94d07c0  0 osd.6 41079 load_pgs opened 501 pgs
2016-03-21 10:40:02.885873 7f7dc6061700  0 osd.6 41079 ignoring osdmap until we have initialized
2016-03-21 10:40:02.886367 7f7dc6061700  0 osd.6 41079 ignoring osdmap until we have initialized
2016-03-21 10:40:04.142036 7f7dd1bdf700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6806/3022304 pipe(0x3ec1180 sd=767 :34709 s=1 pgs=0 cs=0 l=0 c=0x2bfba9a0).connect claims to be 192.168.20.6:6806/39536 not 192.168.20.6:6806/3022304 - wrong node!
2016-03-21 10:40:04.142133 7f7dd1bdf700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6806/3022304 pipe(0x3ec1180 sd=767 :34709 s=1 pgs=0 cs=0 l=0 c=0x2bfba9a0).fault with nothing to send, going to standby
2016-03-21 10:40:04.142203 7f7dc7206700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6803/1033274 pipe(0x3ec1900 sd=770 :44322 s=1 pgs=0 cs=0 l=0 c=0x2bfbb760).connect claims to be 192.168.20.3:6803/25815 not 192.168.20.3:6803/1033274 - wrong node!
2016-03-21 10:40:04.142243 7f7dc7206700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6803/1033274 pipe(0x3ec1900 sd=770 :44322 s=1 pgs=0 cs=0 l=0 c=0x2bfbb760).fault with nothing to send, going to standby
2016-03-21 10:40:04.142218 7f7dd0432700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6800/2008021 pipe(0x3ec1680 sd=769 :59921 s=1 pgs=0 cs=0 l=0 c=0x2bfbc260).connect claims to be 192.168.20.3:6800/25693 not 192.168.20.3:6800/2008021 - wrong node!
2016-03-21 10:40:04.142214 7f7dd0533700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6804/1033523 pipe(0x3ec1400 sd=768 :60358 s=1 pgs=0 cs=0 l=0 c=0x2bfbb4a0).connect claims to be 192.168.20.3:6804/25869 not 192.168.20.3:6804/1033523 - wrong node!
2016-03-21 10:40:04.142284 7f7dd0432700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6800/2008021 pipe(0x3ec1680 sd=769 :59921 s=1 pgs=0 cs=0 l=0 c=0x2bfbc260).fault with nothing to send, going to standby
2016-03-21 10:40:04.142298 7f7dd0533700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6804/1033523 pipe(0x3ec1400 sd=768 :60358 s=1 pgs=0 cs=0 l=0 c=0x2bfbb4a0).fault with nothing to send, going to standby
2016-03-21 10:40:04.142729 7f7dc7105700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6806/2033606 pipe(0x3ec1b80 sd=771 :59106 s=1 pgs=0 cs=0 l=0 c=0x2bfbc3c0).connect claims to be 192.168.20.3:6806/25871 not 192.168.20.3:6806/2033606 - wrong node!
2016-03-21 10:40:04.142797 7f7dc7004700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6812/1008023 pipe(0x3ec1e00 sd=772 :46722 s=1 pgs=0 cs=0 l=0 c=0x2bfbd180).connect claims to be 192.168.20.3:6812/25983 not 192.168.20.3:6812/1008023 - wrong node!
2016-03-21 10:40:04.142838 7f7dc7004700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6812/1008023 pipe(0x3ec1e00 sd=772 :46722 s=1 pgs=0 cs=0 l=0 c=0x2bfbd180).fault with nothing to send, going to standby
2016-03-21 10:40:04.142902 7f7dc7105700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6806/2033606 pipe(0x3ec1b80 sd=771 :59106 s=1 pgs=0 cs=0 l=0 c=0x2bfbc3c0).fault with nothing to send, going to standby
2016-03-21 10:40:04.143123 7f7dc6f03700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6800/3007813 pipe(0x3ec2080 sd=774 :48846 s=1 pgs=0 cs=0 l=0 c=0x2bfbdb20).connect claims to be 192.168.20.6:6800/39290 not 192.168.20.6:6800/3007813 - wrong node!
2016-03-21 10:40:04.143168 7f7dc6f03700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6800/3007813 pipe(0x3ec2080 sd=774 :48846 s=1 pgs=0 cs=0 l=0 c=0x2bfbdb20).fault with nothing to send, going to standby
2016-03-21 10:40:04.143282 7f7dc69e1700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.5:6831/32336 pipe(0x3ec2580 sd=775 :0 s=1 pgs=0 cs=0 l=0 c=0x2d33e840).fault with nothing to send, going to standby
2016-03-21 10:40:04.143432 7f7dc63c3700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6844/2022850 pipe(0x3ec2d00 sd=777 :0 s=1 pgs=0 cs=0 l=0 c=0x2d33f080).fault with nothing to send, going to standby
2016-03-21 10:40:04.143512 7f7dc68e0700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6818/2007726 pipe(0x3ec2800 sd=776 :40939 s=1 pgs=0 cs=0 l=0 c=0x2d33f8c0).connect claims to be 192.168.20.6:6818/39642 not 192.168.20.6:6818/2007726 - wrong node!
2016-03-21 10:40:04.143559 7f7dc68e0700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6818/2007726 pipe(0x3ec2800 sd=776 :40939 s=1 pgs=0 cs=0 l=0 c=0x2d33f8c0).fault with nothing to send, going to standby
2016-03-21 10:40:04.143842 7f7dc5860700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6820/1008091 pipe(0x3ec2f80 sd=778 :57007 s=1 pgs=0 cs=0 l=0 c=0x2d3415a0).connect claims to be 192.168.20.3:6820/26380 not 192.168.20.3:6820/1008091 - wrong node!
2016-03-21 10:40:04.143885 7f7dc5860700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.3:6820/1008091 pipe(0x3ec2f80 sd=778 :57007 s=1 pgs=0 cs=0 l=0 c=0x2d3415a0).fault with nothing to send, going to standby
2016-03-21 10:40:04.143888 7f7dc575f700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6832/3007759 pipe(0x3ec3200 sd=779 :0 s=1 pgs=0 cs=0 l=0 c=0x2d364100).fault with nothing to send, going to standby
2016-03-21 10:40:04.143957 7f7dc5323700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6842/1030830 pipe(0x3ec3c00 sd=781 :0 s=1 pgs=0 cs=0 l=0 c=0x2d364520).fault with nothing to send, going to standby
2016-03-21 10:40:04.144042 7f7dc5424700  0 -- 192.168.20.5:6806/13424 >> 192.168.20.6:6802/4007755 pipe(0x3ec3700 sd=780 :51544 s=1 pgs=0 cs=0 l=0 c=0x2d363760).connect claims to be 192.168.20.6:6802/39383 not 192.168.20.6:6802/4007755 - wrong node!