[RHEL 9.4] Blk-mq I/O gets stalled on hotplug CPU which is part of isolcpu.

Solution Verified - Updated -

Issue

  • The process which is doing I/O operation gets block on hotplug cpu which is part isolcpus.
kernel: sysrq: Show Blocked State
kernel: task:dd              state:D stack:0     pid:3716  ppid:3432   flags:0x00004002
kernel: Call Trace:
kernel: <TASK>
kernel: __schedule+0x21b/0x550
kernel: schedule+0x2d/0x70
kernel: schedule_timeout+0x88/0x160
kernel: ? __pfx_process_timeout+0x10/0x10
kernel: msleep+0x29/0x40
kernel: __blk_mq_alloc_requests+0x1b3/0x2c0
kernel: blk_mq_submit_bio+0x1ae/0x580
kernel: __submit_bio_noacct+0x7e/0x1e0
kernel: iomap_submit_ioend+0x4e/0x80
kernel: xfs_vm_writepages+0x7a/0xb0 [xfs]
kernel: do_writepages+0xcc/0x1d0
kernel: ? __mod_lruvec_page_state+0x11b/0x160
kernel: filemap_fdatawrite_wbc+0x66/0x90
kernel: __filemap_fdatawrite_range+0x54/0x80
kernel: filemap_write_and_wait_range+0x41/0xb0
kernel: xfs_setattr_size+0xb7/0x380 [xfs]
kernel: xfs_vn_setattr+0x78/0x180 [xfs]
kernel: notify_change+0x3c5/0x550
kernel: ? __d_lookup+0x73/0xb0
kernel: ? do_truncate+0x7d/0xd0
kernel: do_truncate+0x7d/0xd0
kernel: do_open+0x2d5/0x450
kernel: path_openat+0x111/0x280
kernel: do_filp_open+0xb2/0x160
kernel: ? __check_object_size.part.0+0x47/0xd0
kernel: do_sys_openat2+0x96/0xd0
kernel: ? filp_close+0x59/0x70
kernel: __x64_sys_openat+0x53/0xa0
kernel: do_syscall_64+0x59/0x90
kernel: ? __ct_user_enter+0x5a/0xd0
kernel: ? syscall_exit_to_user_mode+0x22/0x40
kernel: ? do_syscall_64+0x69/0x90
kernel: ? sched_clock+0xc/0x30
kernel: ? get_vtime_delta+0xf/0xe0
kernel: ? ct_kernel_exit.constprop.0+0x81/0xa0
kernel: ? __ct_user_enter+0x5a/0xd0
kernel: ? syscall_exit_to_user_mode+0x22/0x40
kernel: ? do_syscall_64+0x69/0x90
kernel: ? syscall_exit_to_user_mode+0x22/0x40
kernel: ? do_syscall_64+0x69/0x90
kernel: ? ct_kernel_exit.constprop.0+0x81/0xa0
kernel: ? __ct_user_enter+0x5a/0xd0
kernel: entry_SYSCALL_64_after_hwframe+0x72/0xdc
kernel: RIP: 0033:0x7f7febd3e5db
kernel: RSP: 002b:00007fff5852d630 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
kernel: RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f7febd3e5db
kernel: RDX: 0000000000000241 RSI: 00007fff5852f50d RDI: 00000000ffffff9c
kernel: RBP: 00007fff5852f50d R08: 000000000000003d R09: 0000000000001838
kernel: R10: 00000000000001b6 R11: 0000000000000246 R12: 0000000000000241
kernel: R13: 0000000000000241 R14: 00007fff5852f50d R15: 00007fff5852f528
kernel: </TASK>

Environment

  • Red Hat Enterprise Linux 9.4

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content