Hard lockup on virtual system while in pvscsi_queue()

Solution Unverified - Updated -

Issue

  • Hard lockup on virtual system while in pvscsi_queue():
[5962480.238849] NMI watchdog: Watchdog detected hard LOCKUP on cpu 5
[5962480.238908] Modules linked in:
....
[5962480.238989] CPU: 5 PID: 248923 Comm: kworker/u16:1 Kdump: loaded Tainted: G               ------------ T 3.10.0-1160.el7.x86_64 #1
[5962480.238991] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.17369862.B64.2012240522 12/24/2020
[5962480.238998] Workqueue: writeback bdi_writeback_workfn (flush-253:2)
[5962480.239000] Call Trace:
[5962480.239002]  <NMI>  [<ffffffff99981340>] dump_stack+0x19/0x1b
....
[5962480.239038]  [<ffffffff993174cd>] ? native_queued_spin_lock_slowpath+0x1d/0x200
[5962480.239039]  <EOE>  [<ffffffff9997b37b>] queued_spin_lock_slowpath+0xb/0xf
[5962480.239042]  [<ffffffff99989b17>] _raw_spin_lock_irqsave+0x37/0x40
[5962480.239046]  [<ffffffffc027b1b5>] pvscsi_queue+0x25/0x920 [vmw_pvscsi]
[5962480.239051]  [<ffffffffc03e2f0f>] ? sd_init_command+0x2f/0xc0 [sd_mod]
[5962480.239054]  [<ffffffff996eb081>] ? scsi_setup_cmnd+0x111/0x1c0
[5962480.239055]  [<ffffffff996eb20b>] ? scsi_prep_fn+0xdb/0x180
[5962480.239058]  [<ffffffff996e3980>] scsi_dispatch_cmd+0xb0/0x240
[5962480.239060]  [<ffffffff996ed0ac>] scsi_request_fn+0x4ac/0x680
[5962480.239063]  [<ffffffff99577f8e>] ? deadline_add_request+0x6e/0x90
[5962480.239066]  [<ffffffff995534d9>] __blk_run_queue+0x39/0x50
[5962480.239068]  [<ffffffff995571e3>] blk_queue_bio+0x3b3/0x400
[5962480.239070]  [<ffffffff99555167>] generic_make_request+0x147/0x380
[5962480.239071]  [<ffffffff99555410>] submit_bio+0x70/0x150
[5962480.239125]  [<ffffffffc04d9f31>] xfs_submit_ioend.isra.12+0x61/0xe0 [xfs]
[5962480.239137]  [<ffffffffc04da26f>] xfs_vm_writepages+0x7f/0xa0 [xfs]
[5962480.239139]  [<ffffffff993cade1>] do_writepages+0x21/0x50
[5962480.239141]  [<ffffffff9947d6f0>] __writeback_single_inode+0x40/0x260
[5962480.239143]  [<ffffffff992c6cd5>] ? wake_up_bit+0x25/0x30
[5962480.239145]  [<ffffffff9947e274>] writeback_sb_inodes+0x1c4/0x430
[5962480.239146]  [<ffffffff9947e57f>] __writeback_inodes_wb+0x9f/0xd0
[5962480.239148]  [<ffffffff9947ea53>] wb_writeback+0x263/0x2f0
[5962480.239150]  [<ffffffff9946a67c>] ? get_nr_inodes+0x4c/0x70
[5962480.239152]  [<ffffffff9947f64b>] bdi_writeback_workfn+0x2cb/0x460
....
[5962480.239167] Kernel panic - not syncing: Hard LOCKUP
[5962480.239181] CPU: 5 PID: 248923 Comm: kworker/u16:1 Kdump: loaded Tainted: G               ------------ T 3.10.0-1160.el7.x86_64 #1
[5962480.239210] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.17369862.B64.2012240522 12/24/2020
[5962480.239255] Workqueue: writeback bdi_writeback_workfn (flush-253:2)
[5962480.239272] Call Trace:
[5962480.239280]  <NMI>  [<ffffffff99981340>] dump_stack+0x19/0x1b
....
[5962480.239625]  [<ffffffff993174cd>] ? native_queued_spin_lock_slowpath+0x1d/0x200
[5962480.239642]  <EOE>  [<ffffffff9997b37b>] queued_spin_lock_slowpath+0xb/0xf
[5962480.239673]  [<ffffffff99989b17>] _raw_spin_lock_irqsave+0x37/0x40
[5962480.239691]  [<ffffffffc027b1b5>] pvscsi_queue+0x25/0x920 [vmw_pvscsi]
[5962480.239721]  [<ffffffffc03e2f0f>] ? sd_init_command+0x2f/0xc0 [sd_mod]
[5962480.239738]  [<ffffffff996eb081>] ? scsi_setup_cmnd+0x111/0x1c0
[5962480.239766]  [<ffffffff996eb20b>] ? scsi_prep_fn+0xdb/0x180
[5962480.239781]  [<ffffffff996e3980>] scsi_dispatch_cmd+0xb0/0x240
[5962480.239796]  [<ffffffff996ed0ac>] scsi_request_fn+0x4ac/0x680
[5962480.239824]  [<ffffffff99577f8e>] ? deadline_add_request+0x6e/0x90
[5962480.239839]  [<ffffffff995534d9>] __blk_run_queue+0x39/0x50
[5962480.239866]  [<ffffffff995571e3>] blk_queue_bio+0x3b3/0x400
[5962480.239881]  [<ffffffff99555167>] generic_make_request+0x147/0x380
[5962480.239897]  [<ffffffff99555410>] submit_bio+0x70/0x150
[5962480.239934]  [<ffffffffc04d9f31>] xfs_submit_ioend.isra.12+0x61/0xe0 [xfs]
[5962480.239959]  [<ffffffffc04da26f>] xfs_vm_writepages+0x7f/0xa0 [xfs]
[5962480.239989]  [<ffffffff993cade1>] do_writepages+0x21/0x50
[5962480.240003]  [<ffffffff9947d6f0>] __writeback_single_inode+0x40/0x260
[5962480.240020]  [<ffffffff992c6cd5>] ? wake_up_bit+0x25/0x30
[5962480.240046]  [<ffffffff9947e274>] writeback_sb_inodes+0x1c4/0x430
[5962480.240542]  [<ffffffff9947e57f>] __writeback_inodes_wb+0x9f/0xd0
[5962480.241006]  [<ffffffff9947ea53>] wb_writeback+0x263/0x2f0
[5962480.241468]  [<ffffffff9946a67c>] ? get_nr_inodes+0x4c/0x70
[5962480.241927]  [<ffffffff9947f64b>] bdi_writeback_workfn+0x2cb/0x460
....

Environment

  • Red Hat Enterprise Linux 7

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content