OSDs does not start automatically while rebooting an OSD node.

Solution In Progress - Updated -

Issue

  • OSD processes does not start automatically while rebooting an OSD node.

  • The OSDs are mounted properly, even if the OSD process is not started at boot. This is possible since OSD disks are mounted with ceph-disk.

  • The OSD logs show the following:

2015-10-07 15:33:46.927251 7fb20abd7700 10 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6912/11717 pipe(0x17ccc800 sd=140 :53070 s=4 pgs=593 cs=11 l=0 c=0x17f51760).unregister_pipe - not registered
2015-10-07 15:33:46.927261 7fb20abd7700 20 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6912/11717 pipe(0x17ccc800 sd=140 :53070 s=4 pgs=593 cs=11 l=0 c=0x17f51760).join
2015-10-07 15:33:46.927324 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper reaped pipe 0x17ccc800 172.16.92.11:6912/11717
2015-10-07 15:33:46.927360 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper deleted pipe 0x17ccc800
2015-10-07 15:33:46.927375 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper reaping pipe 0x17545800 172.16.92.11:6906/1254
2015-10-07 15:33:46.927383 7fb20abd7700 10 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6906/1254 pipe(0x17545800 sd=167 :6809 s=4 pgs=578 cs=11 l=0 c=0x18eee460).discard_queue
2015-10-07 15:33:46.927395 7fb20abd7700 10 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6906/1254 pipe(0x17545800 sd=167 :6809 s=4 pgs=578 cs=11 l=0 c=0x18eee460).unregister_pipe - not registered
2015-10-07 15:33:46.927404 7fb20abd7700 20 -- 172.16.92.25:6809/41950 >> 172.16.92.11:6906/1254 pipe(0x17545800 sd=167 :6809 s=4 pgs=578 cs=11 l=0 c=0x18eee460).join
2015-10-07 15:33:46.927488 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper reaped pipe 0x17545800 172.16.92.11:6906/1254
2015-10-07 15:33:46.927512 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper deleted pipe 0x17545800
2015-10-07 15:33:46.927518 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper done
2015-10-07 15:33:46.927523 7fb20abd7700 10 -- 172.16.92.25:6809/41950 reaper_entry done
2015-10-07 15:33:46.927836 7fb2133ac880 20 -- 172.16.92.25:6809/41950 wait: stopped reaper thread
2015-10-07 15:33:46.927871 7fb2133ac880 10 -- 172.16.92.25:6809/41950 wait: closing pipes
2015-10-07 15:33:46.927879 7fb2133ac880 10 -- 172.16.92.25:6809/41950 reaper
2015-10-07 15:33:46.927888 7fb2133ac880 10 -- 172.16.92.25:6809/41950 reaper done
2015-10-07 15:33:46.927895 7fb2133ac880 10 -- 172.16.92.25:6809/41950 wait: waiting for pipes to close
2015-10-07 15:33:46.927903 7fb2133ac880 10 -- 172.16.92.25:6809/41950 wait: done.
2015-10-07 15:33:46.927910 7fb2133ac880 1 -- 172.16.92.25:6809/41950 shutdown complete.
2015-10-07 15:33:46.927918 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: waiting for dispatch queue
2015-10-07 15:33:46.928370 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: dispatch queue is stopped
2015-10-07 15:33:46.928392 7fb2133ac880 20 -- 172.16.93.25:0/41950 wait: stopping reaper thread
2015-10-07 15:33:46.928425 7fb20a3d6700 10 -- 172.16.93.25:0/41950 reaper_entry done
2015-10-07 15:33:46.928676 7fb2133ac880 20 -- 172.16.93.25:0/41950 wait: stopped reaper thread
2015-10-07 15:33:46.928696 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: closing pipes
2015-10-07 15:33:46.928704 7fb2133ac880 10 -- 172.16.93.25:0/41950 reaper
2015-10-07 15:33:46.928712 7fb2133ac880 10 -- 172.16.93.25:0/41950 reaper done
2015-10-07 15:33:46.928718 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: waiting for pipes to close
2015-10-07 15:33:46.928725 7fb2133ac880 10 -- 172.16.93.25:0/41950 wait: done.
2015-10-07 15:33:46.928732 7fb2133ac880 1 -- 172.16.93.25:0/41950 shutdown complete.
  • Once the OSDs are manually restarted, the process gets started.

Environment

  • Red Hat Enterprise Linux 7.1

  • Upstream Ceph Hammper (0.94.3-0)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content