The watchdog timer and vxfs causes INFO: task khugepaged:pppp blocked for more than xxx seconds type messages to be logged and hung IO in RHEL 6.
Issue
- We log messages of the below type stating that a task/s have been hung for more that xxx seconds. The default time is 120 seconds.
INFO: task khugepaged:421 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
khugepaged D 0000000000000020 0 421 2 0x00000000
ffff8820100e3c90 0000000000000046 0000000000000000 ffff88000002dd40
ffff8820100e1540 00000000004352da ffff8820100e3d40 ffffffff8112bae3
ffff8820100e1af8 ffff8820100e3fd8 000000000000fb88 ffff8820100e1af8
Call Trace:
[<ffffffff8112bae3>] ? __alloc_pages_nodemask+0x113/0x8d0
[<ffffffff8150fc45>] rwsem_down_failed_common+0x95/0x1d0
[<ffffffff8150fda3>] rwsem_down_write_failed+0x23/0x30
[<ffffffff812833e3>] call_rwsem_down_write_failed+0x13/0x20
[<ffffffff8150f2a2>] ? down_write+0x32/0x40
[<ffffffff81179eb6>] khugepaged+0x7f6/0x1310
[<ffffffff81096c80>] ? autoremove_wake_function+0x0/0x40
[<ffffffff811796c0>] ? khugepaged+0x0/0x1310
[<ffffffff81096916>] kthread+0x96/0xa0
[<ffffffff8100c0ca>] child_rip+0xa/0x20
[<ffffffff81096880>] ? kthread+0x0/0xa0
[<ffffffff8100c0c0>] ? child_rip+0x0/0x20
<snip>
INFO: task vx_naio_worker:41196 blocked for more than 120 seconds.
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
vx_naio_worke D 0000000000000000 0 41196 2 0x00000080
ffff8809e9ee3c40 0000000000000046 ffff880099b56798 ffff880099b56768
ffff880123a95578 000000000022feba ffff880123a95540 0000000000000000
ffff88080815f098 ffff8809e9ee3fd8 000000000000fb88 ffff88080815f098
Call Trace:
[<ffffffffa05610ce>] vx_svar_sleep_unlock+0x6e/0xd0 [vxfs]
[<ffffffffa0560e60>] ? vx_wq_wakeup_function+0x0/0x20 [vxfs]
[<ffffffff8106317e>] ? try_to_wake_up+0x24e/0x3e0
[<ffffffffa0537b09>] vx_rwsleep_rec_lock+0xd9/0x110 [vxfs]
[<ffffffffa05044b2>] vx_recsmp_lock+0x12/0x20 [vxfs]
[<ffffffffa0620f75>] vx_write_common+0x1e5/0x860 [vxfs]
[<ffffffff81051419>] ? __wake_up_common+0x59/0x90
[<ffffffffa059f110>] vx_vop_write+0x20/0x30 [vxfs]
[<ffffffffa057f2e2>] vx_naio_do_work+0x1a2/0x440 [vxfs]
[<ffffffffa057f609>] vx_naio_worker+0x89/0x2b0 [vxfs]
[<ffffffffa057f580>] ? vx_naio_worker+0x0/0x2b0 [vxfs]
[<ffffffffa059388b>] vx_kthread_init+0x7b/0x90 [vxfs]
[<ffffffffa057f580>] ? vx_naio_worker+0x0/0x2b0 [vxfs]
[<ffffffff8100c0ca>] child_rip+0xa/0x20
[<ffffffffa057f580>] ? vx_naio_worker+0x0/0x2b0 [vxfs]
[<ffffffffa0593810>] ? vx_kthread_init+0x0/0x90 [vxfs]
[<ffffffff8100c0c0>] ? child_rip+0x0/0x20
Environment
- Red Hat Enterprise Linux 6
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
