The kernel crashes where lots of tasks are waiting on mutex of which owner is waiting on rw_semaphore with that mutex being held. The rw_semaphore is being held by another task that is processing page reclaiming.

Issue

• The kernel crashes where lots of tasks are waiting on mutex of which owner is waiting on rw_semaphore with that mutex being held. The rw_semaphore is being held by another task that is processing page reclaiming where the system is running short of memory.

[37845649.731921] INFO: task diagnostic_con*:10758 blocked for more than 120 seconds.
[37845649.732862] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[37845649.733732] diagnostic_con* D ffff9c7b72b84100     0 10758   2474 0x00000080
[37845649.733737] Call Trace:
[37845649.733749]  [<ffffffff8d569df9>] schedule_preempt_disabled+0x29/0x70
[37845649.733753]  [<ffffffff8d567d77>] __mutex_lock_slowpath+0xc7/0x1d0
[37845649.733755]  [<ffffffff8d56715f>] mutex_lock+0x1f/0x2f
[37845649.733759]  [<ffffffff8d042695>] SyS_write+0x65/0xf0
[37845649.733764]  [<ffffffff8d575ddb>] system_call_fastpath+0x22/0x27

[37845649.734143] Kernel panic - not syncing: hung_task: blocked tasks
[37845649.735004] CPU: 7 PID: 133 Comm: khungtaskd Kdump: loaded Tainted: P           OE  ------------   3.10.0-957.21.3.el7.x86_64 #1
[37845649.736740] Hardware name: HP ProLiant DL380 Gen9/ProLiant DL380 Gen9, BIOS P89 01/22/2018
[37845649.737634] Call Trace:
[37845649.738519]  [<ffffffff8d563107>] dump_stack+0x19/0x1b
[37845649.739410]  [<ffffffff8d55c810>] panic+0xe8/0x21f
[37845649.740306]  [<ffffffff8cf48e4e>] watchdog+0x26e/0x2c0
[37845649.741197]  [<ffffffff8cf48be0>] ? reset_hung_task_detector+0x20/0x20
[37845649.742088]  [<ffffffff8cec1da1>] kthread+0xd1/0xe0
[37845649.742977]  [<ffffffff8cec1cd0>] ? insert_kthread_work+0x40/0x40
[37845649.743869]  [<ffffffff8d575c37>] ret_from_fork_nospec_begin+0x21/0x21
[37845649.744752]  [<ffffffff8cec1cd0>] ? insert_kthread_work+0x40/0x40