Hard lockup on virtual system while in pvscsi_queue()
Issue
- Hard lockup on virtual system while in
pvscsi_queue()
:
[5962480.238849] NMI watchdog: Watchdog detected hard LOCKUP on cpu 5
[5962480.238908] Modules linked in:
....
[5962480.238989] CPU: 5 PID: 248923 Comm: kworker/u16:1 Kdump: loaded Tainted: G ------------ T 3.10.0-1160.el7.x86_64 #1
[5962480.238991] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.17369862.B64.2012240522 12/24/2020
[5962480.238998] Workqueue: writeback bdi_writeback_workfn (flush-253:2)
[5962480.239000] Call Trace:
[5962480.239002] <NMI> [<ffffffff99981340>] dump_stack+0x19/0x1b
....
[5962480.239038] [<ffffffff993174cd>] ? native_queued_spin_lock_slowpath+0x1d/0x200
[5962480.239039] <EOE> [<ffffffff9997b37b>] queued_spin_lock_slowpath+0xb/0xf
[5962480.239042] [<ffffffff99989b17>] _raw_spin_lock_irqsave+0x37/0x40
[5962480.239046] [<ffffffffc027b1b5>] pvscsi_queue+0x25/0x920 [vmw_pvscsi]
[5962480.239051] [<ffffffffc03e2f0f>] ? sd_init_command+0x2f/0xc0 [sd_mod]
[5962480.239054] [<ffffffff996eb081>] ? scsi_setup_cmnd+0x111/0x1c0
[5962480.239055] [<ffffffff996eb20b>] ? scsi_prep_fn+0xdb/0x180
[5962480.239058] [<ffffffff996e3980>] scsi_dispatch_cmd+0xb0/0x240
[5962480.239060] [<ffffffff996ed0ac>] scsi_request_fn+0x4ac/0x680
[5962480.239063] [<ffffffff99577f8e>] ? deadline_add_request+0x6e/0x90
[5962480.239066] [<ffffffff995534d9>] __blk_run_queue+0x39/0x50
[5962480.239068] [<ffffffff995571e3>] blk_queue_bio+0x3b3/0x400
[5962480.239070] [<ffffffff99555167>] generic_make_request+0x147/0x380
[5962480.239071] [<ffffffff99555410>] submit_bio+0x70/0x150
[5962480.239125] [<ffffffffc04d9f31>] xfs_submit_ioend.isra.12+0x61/0xe0 [xfs]
[5962480.239137] [<ffffffffc04da26f>] xfs_vm_writepages+0x7f/0xa0 [xfs]
[5962480.239139] [<ffffffff993cade1>] do_writepages+0x21/0x50
[5962480.239141] [<ffffffff9947d6f0>] __writeback_single_inode+0x40/0x260
[5962480.239143] [<ffffffff992c6cd5>] ? wake_up_bit+0x25/0x30
[5962480.239145] [<ffffffff9947e274>] writeback_sb_inodes+0x1c4/0x430
[5962480.239146] [<ffffffff9947e57f>] __writeback_inodes_wb+0x9f/0xd0
[5962480.239148] [<ffffffff9947ea53>] wb_writeback+0x263/0x2f0
[5962480.239150] [<ffffffff9946a67c>] ? get_nr_inodes+0x4c/0x70
[5962480.239152] [<ffffffff9947f64b>] bdi_writeback_workfn+0x2cb/0x460
....
[5962480.239167] Kernel panic - not syncing: Hard LOCKUP
[5962480.239181] CPU: 5 PID: 248923 Comm: kworker/u16:1 Kdump: loaded Tainted: G ------------ T 3.10.0-1160.el7.x86_64 #1
[5962480.239210] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.17369862.B64.2012240522 12/24/2020
[5962480.239255] Workqueue: writeback bdi_writeback_workfn (flush-253:2)
[5962480.239272] Call Trace:
[5962480.239280] <NMI> [<ffffffff99981340>] dump_stack+0x19/0x1b
....
[5962480.239625] [<ffffffff993174cd>] ? native_queued_spin_lock_slowpath+0x1d/0x200
[5962480.239642] <EOE> [<ffffffff9997b37b>] queued_spin_lock_slowpath+0xb/0xf
[5962480.239673] [<ffffffff99989b17>] _raw_spin_lock_irqsave+0x37/0x40
[5962480.239691] [<ffffffffc027b1b5>] pvscsi_queue+0x25/0x920 [vmw_pvscsi]
[5962480.239721] [<ffffffffc03e2f0f>] ? sd_init_command+0x2f/0xc0 [sd_mod]
[5962480.239738] [<ffffffff996eb081>] ? scsi_setup_cmnd+0x111/0x1c0
[5962480.239766] [<ffffffff996eb20b>] ? scsi_prep_fn+0xdb/0x180
[5962480.239781] [<ffffffff996e3980>] scsi_dispatch_cmd+0xb0/0x240
[5962480.239796] [<ffffffff996ed0ac>] scsi_request_fn+0x4ac/0x680
[5962480.239824] [<ffffffff99577f8e>] ? deadline_add_request+0x6e/0x90
[5962480.239839] [<ffffffff995534d9>] __blk_run_queue+0x39/0x50
[5962480.239866] [<ffffffff995571e3>] blk_queue_bio+0x3b3/0x400
[5962480.239881] [<ffffffff99555167>] generic_make_request+0x147/0x380
[5962480.239897] [<ffffffff99555410>] submit_bio+0x70/0x150
[5962480.239934] [<ffffffffc04d9f31>] xfs_submit_ioend.isra.12+0x61/0xe0 [xfs]
[5962480.239959] [<ffffffffc04da26f>] xfs_vm_writepages+0x7f/0xa0 [xfs]
[5962480.239989] [<ffffffff993cade1>] do_writepages+0x21/0x50
[5962480.240003] [<ffffffff9947d6f0>] __writeback_single_inode+0x40/0x260
[5962480.240020] [<ffffffff992c6cd5>] ? wake_up_bit+0x25/0x30
[5962480.240046] [<ffffffff9947e274>] writeback_sb_inodes+0x1c4/0x430
[5962480.240542] [<ffffffff9947e57f>] __writeback_inodes_wb+0x9f/0xd0
[5962480.241006] [<ffffffff9947ea53>] wb_writeback+0x263/0x2f0
[5962480.241468] [<ffffffff9946a67c>] ? get_nr_inodes+0x4c/0x70
[5962480.241927] [<ffffffff9947f64b>] bdi_writeback_workfn+0x2cb/0x460
....
Environment
- Red Hat Enterprise Linux 7
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.