System hang at 'mem_cgroup_css_online()'

Solution In Progress - Updated -

Issue

  • System hang in the below call trace.
[1882482.153486] INFO: task systemd:1 blocked for more than 122 seconds.
[1882482.153495]       Tainted: G           OE     -------  ---  5.14.0-427.127.1.el9_4.x86_64 #1
[1882482.153497] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[1882482.153498] task:systemd         state:D stack:0     pid:1     ppid:0      flags:0x00000002
[1882482.153503] Call Trace:
[1882482.153504]  <TASK>
[1882482.153507]  __schedule+0x21b/0x550
[1882482.153516]  schedule+0x2d/0x70
[1882482.153518]  schedule_preempt_disabled+0x11/0x20
[1882482.153520]  rwsem_down_write_slowpath+0x23d/0x500
[1882482.153524]  down_write+0x58/0x60
[1882482.153527]  alloc_shrinker_info+0x1f/0x100
[1882482.153535]  mem_cgroup_css_online+0x98/0x1c0
[1882482.153539]  online_css+0x19/0x70
[1882482.153544]  cgroup_apply_control_enable+0x1f7/0x2f0
[1882482.153550]  cgroup_mkdir+0xe3/0x1a0
[1882482.153553]  kernfs_iop_mkdir+0x54/0x80
[1882482.153559]  vfs_mkdir+0xfe/0x1d0
[1882482.153564]  do_mkdirat+0x131/0x160
[1882482.153569]  __x64_sys_mkdir+0x48/0x70
[1882482.153571]  do_syscall_64+0x59/0x90
[1882482.153579]  ? sched_clock+0xc/0x30
[1882482.153585]  ? sched_clock_cpu+0x9/0xc0
[1882482.153591]  ? irqtime_account_irq+0x3c/0xb0
[1882482.153596]  ? clear_bhb_loop+0x35/0x90
[1882482.153599]  ? clear_bhb_loop+0x35/0x90
[1882482.153600]  ? clear_bhb_loop+0x35/0x90
[1882482.153601]  ? clear_bhb_loop+0x35/0x90
[1882482.153602]  ? clear_bhb_loop+0x35/0x90
[1882482.153604]  entry_SYSCALL_64_after_hwframe+0x77/0xe1
[1882482.153610] RIP: 0033:0x7f7c1f0fd62b
[1882482.153636] RSP: 002b:00007fffddb08d98 EFLAGS: 00000246 ORIG_RAX: 0000000000000053
[1882482.153639] RAX: ffffffffffffffda RBX: 0000560818b92dc0 RCX: 00007f7c1f0fd62b
[1882482.153641] RDX: 0000000000000000 RSI: 00000000000001ed RDI: 000056081872aca0
[1882482.153642] RBP: 00007fffddb08dd0 R08: 000000000000001b R09: 0000000000000000
[1882482.153644] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[1882482.153645] R13: 00000000000003a9 R14: 00007f7c1f699cdf R15: 00000000000003a9
[1882482.153648]  </TASK>

Environment

  • Red Hat Enterprise Linux 9.4

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content