System hang due to deadlock caused by vxvm_submit_diskio()

Solution Unverified - Updated -

Issue

  • System hang due to deadlock caused by vxvm_submit_diskio():
INFO: task vx_worklist_thr:2044 blocked for more than 120 seconds.
      Tainted: P           OE    --------- -  - 4.18.0-372.26.1.el8_6.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:vx_worklist_thr state:D stack:    0 pid: 2044 ppid:     2 flags:0x80004080
Call Trace:
 __schedule+0x2d1/0x830
 ? wbt_exit+0x30/0x30
 ? __wbt_done+0x30/0x30
 schedule+0x35/0xa0
 io_schedule+0x12/0x40
 rq_qos_wait+0xb2/0x120
 ? karma_partition+0x1e0/0x1e0
 ? wbt_exit+0x30/0x30
 wbt_wait+0x92/0xc0
 __rq_qos_throttle+0x23/0x30
 blk_mq_make_request+0x12d/0x5b0
 generic_make_request+0xef/0x350
 vxvm_submit_diskio+0x132/0x290 [vxio]
 volkiostart+0xa35/0x14c0 [vxio]
 ? kmem_cache_alloc+0x13f/0x280
 ? vol_cachealloc+0x2e/0x60 [vxio]
 vxvm_queue_rq+0x4a/0x130 [vxio]
 ? scsi_alloc_sgtables+0x82/0x190
 ? __sbitmap_get_word+0x2a/0x80
 __blk_mq_try_issue_directly+0x15f/0x200
 blk_mq_request_issue_directly+0x4e/0xb0
 ? recalibrate_cpu_khz+0x10/0x10
 blk_mq_try_issue_list_directly+0x5d/0xe0
 blk_mq_sched_insert_requests+0xa0/0xf0
 blk_mq_flush_plug_list+0x135/0x210
 blk_flush_plug_list+0xd7/0x100
 blk_finish_plug+0x21/0x2e
 vx_dev_strategy+0x828/0xb70 [vxfs]
 vx_logbuf_write+0xee/0x1a0 [vxfs]
 vx_logbuf_io+0x1a9/0x290 [vxfs]
 vx_logflush+0x9e/0x110 [vxfs]
 vx_logflush_inode+0x7b/0x90 [vxfs]
 vx_async_iupdat+0x3b4/0x420 [vxfs]
 ? vx_bc_getblk+0x458/0x930 [vxfs]
 ? vx_getblk_bp+0x31/0x80 [vxfs]
 ? vx_getblk_cmn+0x83/0x200 [vxfs]
 vx_iupdat_local+0x4a0/0x820 [vxfs]
 vx_iupdat_local+0x7ba/0x820 [vxfs]
 ? __switch_to_asm+0x41/0x70
....
 vx_iflush_list+0x680/0xd00 [vxfs]
 vx_iflush+0x6a/0x90 [vxfs]
 ? vx_iflush_list+0xd00/0xd00 [vxfs]
 vx_worklist_process.part.6+0x244/0x280 [vxfs]
 ? vx_osdep_deinit+0x1b0/0x1b0 [vxfs]
 vx_worklist_thread+0x91/0xf0 [vxfs]
 ? vx_wll_merge+0x110/0x110 [vxfs]
 vx_kthread_init+0x22/0x30 [vxfs]
 kthread+0x10a/0x120
 ? set_kthread_struct+0x40/0x40
 ret_from_fork+0x35/0x40

Environment

  • Red Hat Enterprise Linux
  • Veritas VxVM

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content