System hang at shutdown in blk_mq_freeze_queue_wait() when using snapapi/snumbd module

Solution Unverified - Updated -

Issue

  • System hang in blk_mq_freeze_queue_wait() when using snapapi/snumbd module:
snumbd_open_blk(systemd-udevd,48074): Disable access (1649,9599,9599)...
snumbdctl_release(mms,9709): OK s=00000000549539f0
snumbdctl_open(mms,9709): OK s=00000000549539f0
session_init(mms,9709): OK. kdev=fc:1, len=6251159552 sect=512 s=00000000549539f0 pgrp=(9599).
snumbd_open_blk(systemd-udevd,48081): Disable access (1649,9599,9599)...
snumbdctl_release(mms,9709): OK s=00000000549539f0
snumbdctl_open(mms,9709): OK s=00000000549539f0
....
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:tuned           state:D stack:    0 pid: 3269 ppid:     1 flags:0x00000084
Call Trace:
 __schedule+0x2d1/0x870
 schedule+0x55/0xf0
 blk_mq_freeze_queue_wait+0x46/0xb0
 ? finish_wait+0x80/0x80
 elevator_switch+0x12/0x40
 elv_iosched_store+0x13c/0x1c0
 queue_attr_store+0x45/0x70
 kernfs_fop_write+0x11e/0x1a0
 vfs_write+0xa5/0x1b0
 ksys_write+0x4f/0xb0
 do_syscall_64+0x5b/0x1b0
 entry_SYSCALL_64_after_hwframe+0x61/0xc6
  • System is in hang state with kernel ring buffer as below in RHEL 9 machine.
crash> log | tail
[3003949.506042] session_init(mms,1933): OK. kdev=fb:1, len=2048 sect=512 s=0000000059ae8a1b pgrp=(1440).
[3003949.507078] snumbd_open_blk(systemd-udevd,3159517): Disable access (646,1440,1440)...
[3003949.587719] snumbdctl_release(mms,1933): OK s=0000000059ae8a1b
[3003949.656815] snumbdctl_open(mms,1933): OK s=00000000ba84b471
[3003949.657125] session_init(mms,1933): OK. kdev=fb:1, len=2048 sect=512 s=00000000ba84b471 pgrp=(1440).
[3003949.657348] snumbd_open_blk(systemd-udevd,3159517): Disable access (646,1440,1440)...
[3003949.754683] snumbdctl_release(mms,1933): OK s=00000000ba84b471
[3003949.815066] snumbdctl_open(mms,1933): OK s=000000003ea6aa34
[3003949.815319] session_init(mms,1933): OK. kdev=fb:1, len=2048 sect=512 s=000000003ea6aa34 pgrp=(1440).

Environment

  • Red Hat Enterprise Linux 9
  • Red Hat Enterprise Linux 8
  • snapapi/snumbd modules

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content