OSDs does not start automatically while rebooting an OSD node.
Issue
-
OSD processes does not start automatically while rebooting an OSD node.
-
The OSDs are mounted properly, even if the OSD process is not started at boot. This is possible since OSD disks are mounted with ceph-disk.
-
The OSD logs show the following:
2015-10-07 15:33:46.927251 7fb20abd7700 10 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6912/11717 pipe(0x17ccc800 sd=140 :53070 s=4 pgs=593 cs=11 l=0 c=0x17f51760).unregister_pipe - not registered
2015-10-07 15:33:46.927261 7fb20abd7700 20 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6912/11717 pipe(0x17ccc800 sd=140 :53070 s=4 pgs=593 cs=11 l=0 c=0x17f51760).join
2015-10-07 15:33:46.927324 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper reaped pipe 0x17ccc800 172.16.92.11:6912/11717
2015-10-07 15:33:46.927360 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper deleted pipe 0x17ccc800
2015-10-07 15:33:46.927375 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper reaping pipe 0x17545800 172.16.92.11:6906/1254
2015-10-07 15:33:46.927383 7fb20abd7700 10 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6906/1254 pipe(0x17545800 sd=167 :6809 s=4 pgs=578 cs=11 l=0 c=0x18eee460).discard_queue
2015-10-07 15:33:46.927395 7fb20abd7700 10 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6906/1254 pipe(0x17545800 sd=167 :6809 s=4 pgs=578 cs=11 l=0 c=0x18eee460).unregister_pipe - not registered
2015-10-07 15:33:46.927404 7fb20abd7700 20 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6906/1254 pipe(0x17545800 sd=167 :6809 s=4 pgs=578 cs=11 l=0 c=0x18eee460).join
2015-10-07 15:33:46.927488 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper reaped pipe 0x17545800 172.16.92.11:6906/1254
2015-10-07 15:33:46.927512 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper deleted pipe 0x17545800
2015-10-07 15:33:46.927518 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper done
2015-10-07 15:33:46.927523 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper_entry done
2015-10-07 15:33:46.927836 7fb2133ac880 20 -- 172.16.92.25:6809/41950 wait: stopped reaper thread
2015-10-07 15:33:46.927871 7fb2133ac880 10 -- 172.16.92.25:6809/41950 wait: closing pipes
2015-10-07 15:33:46.927879 7fb2133ac880 10 -- 172.16.92.25:6809/41950 reaper
2015-10-07 15:33:46.927888 7fb2133ac880 10 -- 172.16.92.25:6809/41950 reaper done
2015-10-07 15:33:46.927895 7fb2133ac880 10 -- 172.16.92.25:6809/41950 wait: waiting for pipes to close
2015-10-07 15:33:46.927903 7fb2133ac880 10 -- 172.16.92.25:6809/41950 wait: done.
2015-10-07 15:33:46.927910 7fb2133ac880 1 -- 172.16.92.25:6809/41950 shutdown complete.
2015-10-07 15:33:46.927918 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: waiting for dispatch queue
2015-10-07 15:33:46.928370 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: dispatch queue is stopped
2015-10-07 15:33:46.928392 7fb2133ac880 20 -- 172.16.93.25:0/41950 wait: stopping reaper thread
2015-10-07 15:33:46.928425 7fb20a3d6700 10 -- 172.16.93.25:0/41950 reaper_entry done
2015-10-07 15:33:46.928676 7fb2133ac880 20 -- 172.16.93.25:0/41950 wait: stopped reaper thread
2015-10-07 15:33:46.928696 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: closing pipes
2015-10-07 15:33:46.928704 7fb2133ac880 10 -- 172.16.93.25:0/41950 reaper
2015-10-07 15:33:46.928712 7fb2133ac880 10 -- 172.16.93.25:0/41950 reaper done
2015-10-07 15:33:46.928718 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: waiting for pipes to close
2015-10-07 15:33:46.928725 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: done.
2015-10-07 15:33:46.928732 7fb2133ac880 1 -- 172.16.93.25:0/41950 shutdown complete.
- Once the OSDs are manually restarted, the process gets started.
Environment
-
Red Hat Enterprise Linux 7.1
-
Upstream Ceph Hammper (0.94.3-0)
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.