Stack overrun with XFS and readahead I/O

Issue

• System panicked with the following messages:

[Hardware Error]: Machine check events logged
BUG: scheduling while atomic: nfsd/6249/0xffff880c
Modules linked in: mptctl mptbase nfsd nfs lockd fscache auth_rpcgss nfs_acl sunrpc
BUG: unable to handle kernel paging request at 00000001347ad160
IP: [<ffffffff81058fdd>] task_rq_lock+0x4d/0xa0
PGD 0 
Oops: 0000 [#1] SMP 
last sysfs file: /sys/devices/pci0000:00/0000:00:07.0/0000:06:00.0/host0/scsi_host/host0/3ware_stats
CPU 4 
Modules linked in: mptctl mptbase nfsd nfs lockd fscache auth_rpcgss nfs_acl sunrpc bonding 8021q garp stp llc ipv6 xfs exportfs ext3 jbd fuse iTCO_wdt iTCO_vendor_support serio_raw i2c_i801 lpc_ich mfd_core e1000e raid0 ioatdma i7core_edac edac_core sg igb dca i2c_algo_bit i2c_core ptp pps_core ext4 jbd2 mbcache raid1 sr_mod cdrom sd_mod crc_t10dif usb_storage ahci 3w_sas dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]

Pid: 0, comm: swapper Not tainted 2.6.32-431.11.2.el6.x86_64 #1 Penguin Computing Icebreaker 4724 w/ 2 x 1200W PS/X8DT6
RIP: 0010:[<ffffffff81058fdd>]  [<ffffffff81058fdd>] task_rq_lock+0x4d/0xa0
RSP: 0018:ffff880655403b30  EFLAGS: 00010086
RAX: 0000000036576040 RBX: 0000000000016840 RCX: 0000000000000000
RDX: 0000000000000086 RSI: ffff880655403b88 RDI: ffff880c34e30040
RBP: ffff880655403b50 R08: 0000000000000000 R09: 0000000000000001
R10: ffff880c366afc00 R11: ffff880c366c9800 R12: ffff880c34e30040
R13: ffff880655403b88 R14: 0000000000016840 R15: 0000000000000003
FS:  0000000000000000(0000) GS:ffff880655400000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00000001347ad160 CR3: 0000000c31bdd000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffff880636a02000, task ffff880c36dc1500)
Stack:
 ffff880c34e30040 0000000000000001 0000000000000000 0000000000000004
<d> ffff880655403bc0 ffffffff81065a4c ffff880655403bb0 ffffffff8105a625
<d> ffff8806fe020020 0000000400000004 ffff880c28475a80 0000000000000086
Call Trace:
 <IRQ> 
 [<ffffffff81065a4c>] try_to_wake_up+0x3c/0x3e0
 [<ffffffff8105a625>] ? select_idle_sibling+0x95/0x150
 [<ffffffff81065e02>] default_wake_function+0x12/0x20
 [<ffffffff81054839>] __wake_up_common+0x59/0x90
 [<ffffffff810553e4>] ? scale_rt_power+0x24/0x80
 [<ffffffff81058c47>] complete+0x47/0x60
 [<ffffffffa02dafd5>] ? _xfs_buf_ioend+0x25/0x30 [xfs]
 [<ffffffffa02daf82>] xfs_buf_ioend+0xe2/0x110 [xfs]
 [<ffffffffa02dafd5>] _xfs_buf_ioend+0x25/0x30 [xfs]
 [<ffffffffa02db014>] xfs_buf_bio_end_io+0x34/0x50 [xfs]
 [<ffffffff811c239d>] bio_endio+0x1d/0x40
 [<ffffffff812650fb>] req_bio_endio+0x9b/0xe0
 [<ffffffff81266677>] blk_update_request+0x117/0x490
 [<ffffffff81266a17>] blk_update_bidi_request+0x27/0xa0
 [<ffffffff81268b0f>] blk_end_bidi_request+0x2f/0x80
 [<ffffffff81268bb0>] blk_end_request+0x10/0x20
 [<ffffffff81389d3f>] scsi_io_completion+0xaf/0x6c0
 [<ffffffff810149b9>] ? read_tsc+0x9/0x20
 [<ffffffff810ab3a4>] ? clockevents_program_event+0x54/0xa0
 [<ffffffff813801c2>] scsi_finish_command+0xc2/0x130
 [<ffffffff8138a4b5>] scsi_softirq_done+0x145/0x170
 [<ffffffff8126ea95>] blk_done_softirq+0x85/0xa0
 [<ffffffff8107a8e1>] __do_softirq+0xc1/0x1e0
 [<ffffffff8100c30c>] call_softirq+0x1c/0x30
 [<ffffffff8100fa75>] do_softirq+0x65/0xa0
 [<ffffffff8107a795>] irq_exit+0x85/0x90
 [<ffffffff81030e25>] smp_call_function_single_interrupt+0x35/0x40
 [<ffffffff8100bdb3>] call_function_single_interrupt+0x13/0x20
 <EOI> 
 [<ffffffff812e0bee>] ? intel_idle+0xde/0x170
 [<ffffffff812e0bd1>] ? intel_idle+0xc1/0x170
 [<ffffffff81426b67>] cpuidle_idle_call+0xa7/0x140
 [<ffffffff81009fc6>] cpu_idle+0xb6/0x110
 [<ffffffff8152143c>] start_secondary+0x2ac/0x2ef
Code: c3 40 68 01 00 49 89 fc 49 89 f5 9c 58 0f 1f 44 00 00 48 89 c2 fa 66 0f 1f 44 00 00 49 89 55 00 49 8b 44 24 08 49 89 de 8b 40 18 <4c> 03 34 c5 60 cf bf 81 4c 89 f7 e8 23 19 4d 00 49 8b 44 24 08 
RIP  [<ffffffff81058fdd>] task_rq_lock+0x4d/0xa0
 RSP <ffff880655403b30>
CR2: 00000001347ad160