System crashes by 'kernel: BUG: soft lockup - CPU#0 stuck for 66s!'

Solution Verified - Updated -

Issue

  • System was crashed in the below location as soon as starting JBoss application
Kernel panic - not syncing: softlockup: hung tasks
Pid: 26, comm: watchdog/5 Not tainted 2.6.32-504.el6.x86_64 #1
Call Trace:
 <IRQ>  [<ffffffff815292bc>] ? panic+0xa7/0x16f
 [<ffffffff810ea0c0>] ? watchdog_timer_fn+0x0/0x1e0
 [<ffffffff810ea28a>] ? watchdog_timer_fn+0x1ca/0x1e0
 [<ffffffff810a338e>] ? __run_hrtimer+0x8e/0x1a0
 [<ffffffff810aa78f>] ? ktime_get_update_offsets+0x4f/0xd0
 [<ffffffff810a36f6>] ? hrtimer_interrupt+0xe6/0x260
 [<ffffffff810342fd>] ? local_apic_timer_interrupt+0x3d/0x70
 [<ffffffff81533c05>] ? smp_apic_timer_interrupt+0x45/0x60
 [<ffffffff8100bb93>] ? apic_timer_interrupt+0x13/0x20
 <EOI>  [<ffffffff81060c0f>] ? finish_task_switch+0x4f/0xf0
 [<ffffffff815299be>] ? thread_return+0x4e/0x7d0
 [<ffffffff810ea67a>] ? watchdog+0x9a/0xd0
 [<ffffffff810ea5e0>] ? watchdog+0x0/0xd0
 [<ffffffff8109e66e>] ? kthread+0x9e/0xc0
 [<ffffffff8100c20a>] ? child_rip+0xa/0x20
 [<ffffffff8109e5d0>] ? kthread+0x0/0xc0
 [<ffffffff8100c200>] ? child_rip+0x0/0x20
 [<ffffffff8144fe1e>] ? __kfree_skb+0x1e/0xa0
 [<ffffffff8144fedb>] ? consume_skb+0x3b/0x80
 [<ffffffff814c405b>] ? arp_process+0xeb/0x790
 [<ffffffff810a375b>] ? hrtimer_interrupt+0x14b/0x260
 [<ffffffff814c4821>] ? arp_rcv+0x111/0x140
 [<ffffffff8145c88b>] ? __netif_receive_skb+0x4ab/0x750
 [<ffffffff81460588>] ? netif_receive_skb+0x58/0x60
 [<ffffffffa005876b>] ? vmxnet3_rq_rx_complete+0x3ab/0x8d0 [vmxnet3]
 [<ffffffff812a2bc0>] ? swiotlb_map_page+0x0/0x100
 [<ffffffffa0058e03>] ? vmxnet3_poll_rx_only+0x43/0xc0 [vmxnet3]
 [<ffffffff81087c4f>] ? run_timer_softirq+0x2f/0x340
 [<ffffffff81462083>] ? net_rx_action+0x103/0x2f0
 [<ffffffff8107d8b1>] ? __do_softirq+0xc1/0x1e0
 [<ffffffff810b034a>] ? tick_program_event+0x2a/0x30
 [<ffffffff8100c30c>] ? call_softirq+0x1c/0x30
 [<ffffffff8100fc15>] ? do_softirq+0x65/0xa0
 [<ffffffff8107d765>] ? irq_exit+0x85/0x90
 [<ffffffff81533c0a>] ? smp_apic_timer_interrupt+0x4a/0x60
 [<ffffffff8100bb93>] ? apic_timer_interrupt+0x13/0x20
 <EOI> 

Environment

  • Red Hat Enterprise Linux 6
  • Red Hat Enterprise Linux 7
  • VMware ESX Server

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In