System hang with stalled I/O due to interrupts not proceeding

Solution Unverified - Updated -

Issue

  • System hang with stalled I/O due to interrupts not proceeding:
PID: 1164030  TASK: ff112b9fa49cc000  CPU: 1    COMMAND: "etcd"
 #0 [ff61d9d124aafca8] __schedule at ffffffff927d42fb
 #1 [ff61d9d124aafd00] schedule at ffffffff927d48cc
 #2 [ff61d9d124aafd18] io_schedule at ffffffff927d4fc2
 #3 [ff61d9d124aafd28] wait_on_page_bit at ffffffff9209735c
 #4 [ff61d9d124aafdb8] __filemap_fdatawait_range at ffffffff92095978
 #5 [ff61d9d124aafe80] file_write_and_wait_range at ffffffff9209b9ba
 #6 [ff61d9d124aafeb0] xfs_file_fsync at ffffffffc0704e85 [xfs]
 #7 [ff61d9d124aaff08] do_fsync at ffffffff921861b8
 #8 [ff61d9d124aaff30] __x64_sys_fdatasync at ffffffff92186243
 #9 [ff61d9d124aaff38] do_syscall_64 at ffffffff91e02d47
#10 [ff61d9d124aaff50] entry_SYSCALL_64_after_hwframe at ffffffff928000a9
....

PID: 1164030  TASK: ff112b9fa49cc000  CPU: 1    COMMAND: "etcd"
 #0 [ff61d9d124aafca8] __schedule at ffffffff927d42fb
 #1 [ff61d9d124aafd00] schedule at ffffffff927d48cc
 #2 [ff61d9d124aafd18] io_schedule at ffffffff927d4fc2
 #3 [ff61d9d124aafd28] wait_on_page_bit at ffffffff9209735c
 #4 [ff61d9d124aafdb8] __filemap_fdatawait_range at ffffffff92095978
 #5 [ff61d9d124aafe80] file_write_and_wait_range at ffffffff9209b9ba
 #6 [ff61d9d124aafeb0] xfs_file_fsync at ffffffffc0704e85 [xfs]
 #7 [ff61d9d124aaff08] do_fsync at ffffffff921861b8
 #8 [ff61d9d124aaff30] __x64_sys_fdatasync at ffffffff92186243
 #9 [ff61d9d124aaff38] do_syscall_64 at ffffffff91e02d47
#10 [ff61d9d124aaff50] entry_SYSCALL_64_after_hwframe at ffffffff928000a9
....

PID: 985      TASK: ff112baee979c000  CPU: 0    COMMAND: "kworker/0:1H"
 #0 [ff61d9d109b6fc00] __schedule at ffffffff927d42fb
 #1 [ff61d9d109b6fc58] schedule at ffffffff927d48cc
 #2 [ff61d9d109b6fc70] synchronize_irq at ffffffff91f60402
 #3 [ff61d9d109b6fcb8] nvme_poll_irqdisable at ffffffffc0486a65 [nvme]
 #4 [ff61d9d109b6fd00] nvme_timeout at ffffffffc0488725 [nvme]
 #5 [ff61d9d109b6fd88] blk_mq_check_expired at ffffffff9228e17a
 #6 [ff61d9d109b6fd98] bt_iter at ffffffff922921fd
 #7 [ff61d9d109b6fdc8] blk_mq_queue_tag_busy_iter at ffffffff92292b8d
 #8 [ff61d9d109b6fe60] blk_mq_timeout_work at ffffffff9228d5ee
 #9 [ff61d9d109b6fe90] process_one_work at ffffffff91f0caff
#10 [ff61d9d109b6fed8] worker_thread at ffffffff91f0cdc0
#11 [ff61d9d109b6ff10] kthread at ffffffff91f14631
#12 [ff61d9d109b6ff50] ret_from_fork at ffffffff9280024f
....

Environment

  • Red Hat Enterprise Linux 8
  • Real-time kernel

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content