The system locks up with "BUG: soft lockup" messages in "mwait_idle_with_hints+0x66"
Issue
- The system locks up with "BUG: soft lockup" messages in the system log and in
mwait_idle_with_hints+0x66kernel function according to the call traces:
Apr 6 04:09:58 serv kernel: BUG: soft lockup - CPU#9 stuck for 60s! [swapper:0]
Apr 6 04:09:58 serv kernel: CPU 9:
Apr 6 04:09:58 serv kernel: Modules linked in: mptctl vxgms(PU) vcsmm(PU) vxglm(PU) gab(PU) llt(PU) nfs nfs_acl dmpaa(PU) vxspec(PFU) vxio(PFU) vxdmp(PU) lockd ... ehci_hcd
Apr 6 04:09:58 serv kernel: Pid: 0, comm: swapper Tainted: PF ---- 2.6.18-308.8.1.el5 #1
Apr 6 04:09:58 serv kernel: RIP: 0010:[<ffffffff8006b9cf>] [<ffffffff8006b9cf>] mwait_idle_with_hints+0x66/0x67
Apr 6 04:09:58 serv kernel: RSP: 0018:ffff81091fd67ee8 EFLAGS: 00000246
Apr 6 04:09:58 serv kernel: RAX: 0000000000000000 RBX: 00000000000000ff RCX: 0000000000000000
Apr 6 04:09:58 serv kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
Apr 6 04:09:58 serv kernel: RBP: 00001bc5e60330dd R08: ffff81091fd66000 R09: 0000000000000038
Apr 6 04:09:58 serv kernel: R10: ffff81091fdf0158 R11: ffffffff887351c0 R12: ffff81091e3490c0
Apr 6 04:09:58 serv kernel: R13: ffff81121fe8b860 R14: 0000000000000001 R15: 0000000000000000
Apr 6 04:09:58 serv kernel: FS: 0000000000000000(0000) GS:ffff81121fe8a440(0000) knlGS:0000000000000000
Apr 6 04:09:58 serv kernel: CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Apr 6 04:09:58 serv kernel: CR2: 00002b09765e6020 CR3: 0000000000201000 CR4: 00000000000006a0
Apr 6 04:09:58 serv kernel:
Apr 6 04:09:58 serv kernel: Call Trace:
Apr 6 04:09:58 serv kernel: [<ffffffff80056c6a>] mwait_idle+0xc/0x20
Apr 6 04:09:58 serv kernel: [<ffffffff80048f67>] cpu_idle+0x95/0xb8
Apr 6 04:09:58 serv kernel: [<ffffffff80078ae2>] start_secondary+0x479/0x488
Apr 6 04:31:00 serv kernel: BUG: soft lockup - CPU#11 stuck for 60s! [swapper:0]
Apr 6 04:31:00 serv kernel: CPU 11:
Apr 6 04:31:00 serv kernel: Modules linked in: mptctl vxgms(PU) vcsmm(PU) vxglm(PU) gab(PU) llt(PU) nfs nfs_acl dmpaa(PU) vxspec(PFU) vxio(PFU) vxdmp(PU) lockd ... ehci_hcd
Apr 6 04:31:00 serv kernel: Pid: 0, comm: swapper Tainted: PF ---- 2.6.18-308.8.1.el5 #1
Apr 6 04:31:00 serv kernel: RIP: 0010:[<ffffffff8006b9cf>] [<ffffffff8006b9cf>] mwait_idle_with_hints+0x66/0x67
Apr 6 04:31:00 serv kernel: RSP: 0018:ffff81091fdc7ee8 EFLAGS: 00000246
Apr 6 04:31:00 serv kernel: RAX: 0000000000000000 RBX: 00000000000000ff RCX: 0000000000000000
Apr 6 04:31:00 serv kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
Apr 6 04:31:00 serv kernel: RBP: 00001cebabfbe8d1 R08: ffff81091fdc6000 R09: 0000000000000036
Apr 6 04:31:00 serv kernel: R10: ffff81091fdf01b8 R11: 0000000000000202 R12: ffff8112178a9820
Apr 6 04:31:00 serv kernel: R13: ffff81121fef0820 R14: 0000000000000001 R15: 0000000000000000
Apr 6 04:31:00 serv kernel: FS: 0000000000000000(0000) GS:ffff81121feee7c0(0000) knlGS:0000000000000000
Apr 6 04:31:00 serv kernel: CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Apr 6 04:31:00 serv kernel: CR2: 00002b4271524020 CR3: 0000001214d43000 CR4: 00000000000006a0
Apr 6 04:31:00 serv kernel:
Apr 6 04:31:00 serv kernel: Call Trace:
Apr 6 04:31:00 serv kernel: [<ffffffff80056c6a>] mwait_idle+0xc/0x20
Apr 6 04:31:00 serv kernel: [<ffffffff80048f67>] cpu_idle+0x95/0xb8
Apr 6 04:31:00 serv kernel: [<ffffffff80078ae2>] start_secondary+0x479/0x488
Environment
- Red Hat Enterprise Linux 6
- Red Hat Enterprise Linux 5
- Disabled hardware watchdog by using
nmi_watchdog=0
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.