System rebooted due to blocked tasks

Solution Unverified - Updated -

Issue

  • Frequent reboot (unexpected). Trending show system rebooted once every 2-3 days, usually at night around 12 - 3 am (GMT+0800). No abnormalities found from log. No hardware errors. No application errors. System is in cloud environment.

  • Kernel log shows:

INFO: task pdflush:561 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
pdflush       D ffff810009025e20     0   561    163           562   560 (L-TLB)
 ffff81043e52db00 0000000000000046 0000000000bc0368 ffff81043cd93258
 0000000000000286 000000000000000a ffff81043fb45830 ffff81010eff17f0
 000571522ba70e53 0000000000009046 ffff81043fb45a18 000000048815c9a4
Call Trace:
 [<ffffffff8803200f>] :jbd:start_this_handle+0x2e9/0x370
 [<ffffffff800a3ccf>] autoremove_wake_function+0x0/0x2e
 [<ffffffff800dff1d>] alternate_node_alloc+0x70/0x8c
 [<ffffffff88032161>] :jbd:journal_start+0xcb/0x102
 [<ffffffff8805077c>] :ext3:ext3_ordered_writepage+0x7f/0x19c
 [<ffffffff8001d5b5>] mpage_writepages+0x1bf/0x37d
 [<ffffffff880506fd>] :ext3:ext3_ordered_writepage+0x0/0x19c
 [<ffffffff80157f06>] __next_cpu+0x19/0x28
 [<ffffffff8008dfa7>] find_busiest_group+0x20d/0x621
 [<ffffffff8005aed0>] do_writepages+0x29/0x2f
 [<ffffffff8002ff06>] __writeback_single_inode+0x1a2/0x31c
 [<ffffffff8002e4b9>] __wake_up+0x38/0x4f
 [<ffffffff80021591>] sync_sb_inodes+0x1b7/0x271
 [<ffffffff800a3ab7>] keventd_create_kthread+0x0/0xc4
 [<ffffffff800512f0>] writeback_inodes+0x82/0xd8
 [<ffffffff800cda1d>] wb_kupdate+0xf0/0x16a
 [<ffffffff80056897>] pdflush+0x0/0x1fb
 [<ffffffff800569e8>] pdflush+0x151/0x1fb
 [<ffffffff800cd92d>] wb_kupdate+0x0/0x16a
 [<ffffffff80032c23>] kthread+0xfe/0x132
 [<ffffffff8005dfc1>] child_rip+0xa/0x11
 [<ffffffff800a3ab7>] keventd_create_kthread+0x0/0xc4
 [<ffffffff80032b25>] kthread+0x0/0x132
 [<ffffffff8005dfb7>] child_rip+0x0/0x11

Kernel panic - not syncing: hung_task: blocked tasks

Environment

  • Red hat Enterprise Linux 5.9
  • ext3
  • OS running in a VM

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.