BUG: soft lockup - CPU#10 stuck for 67s! [mozStorage #5:23225]

Latest response

I'm experiencing multiple soft lockups on a RHEL 6.5 box (IBM x3650M3) since a while and can't find a solution.
Does anybody have an idea?

Kind regards

Nov 26 10:27:32 ltsp-1 kernel: BUG: soft lockup - CPU#10 stuck for 67s! [mozStorage #5:23225]
Nov 26 10:27:32 ltsp-1 kernel: Modules linked in: fuse mpt2sas scsi_transport_sas raid_class mptctl mptbase nfsd exportfs autofs4 coretemp nfs lockd fscache auth_rpcgss nfs_acl sunrpc cpufreq_ondemand acpi_cpufreq freq_table mperf bonding 8021q garp stp llc ipv6 vfat fat vhost_net macvtap macvlan tun kvm_intel kvm microcode iTCO_wdt iTCO_vendor_support serio_raw e1000e ptp pps_core bnx2 sg i2c_i801 i2c_core lpc_ich mfd_core ioatdma dca i7core_edac edac_core shpchp ext4 jbd2 mbcache sr_mod cdrom sd_mod crc_t10dif pata_acpi ata_generic ata_piix megaraid_sas dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
Nov 26 10:27:32 ltsp-1 kernel: CPU 10
Nov 26 10:27:32 ltsp-1 kernel: Modules linked in: fuse mpt2sas scsi_transport_sas raid_class mptctl mptbase nfsd exportfs autofs4 coretemp nfs lockd fscache auth_rpcgss nfs_acl sunrpc cpufreq_ondemand acpi_cpufreq freq_table mperf bonding 8021q garp stp llc ipv6 vfat fat vhost_net macvtap macvlan tun kvm_intel kvm microcode iTCO_wdt iTCO_vendor_support serio_raw e1000e ptp pps_core bnx2 sg i2c_i801 i2c_core lpc_ich mfd_core ioatdma dca i7core_edac edac_core shpchp ext4 jbd2 mbcache sr_mod cdrom sd_mod crc_t10dif pata_acpi ata_generic ata_piix megaraid_sas dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
Nov 26 10:27:32 ltsp-1 kernel:
Nov 26 10:27:32 ltsp-1 kernel: Pid: 23225, comm: mozStorage #5 Tainted: G I--------------- 2.6.32-431.el6.x86_64 #1 IBM System x3650 M3 -[7945M2G]-/69Y4438
Nov 26 10:27:32 ltsp-1 kernel: RIP: 0010:[] [] nfs_iocounter_wait+0xa8/0xe0 [nfs]
Nov 26 10:27:32 ltsp-1 kernel: RSP: 0018:ffff88049de4dd28 EFLAGS: 00000246
Nov 26 10:27:32 ltsp-1 kernel: RAX: 0000000000000246 RBX: ffff88049de4dd98 RCX: 000000000000406e
Nov 26 10:27:32 ltsp-1 kernel: RDX: ffff8800280347c0 RSI: 0000000000000246 RDI: 0000000000000246
Nov 26 10:27:32 ltsp-1 kernel: RBP: ffffffff8100bb8e R08: 0000000000000001 R09: 00000000ffffffff
Nov 26 10:27:32 ltsp-1 kernel: R10: 0000000000000000 R11: 0000000000000001 R12: ffff88049de4dd18
Nov 26 10:27:32 ltsp-1 kernel: R13: ffffffff8100b9ce R14: 000000000000f9d4 R15: 0000000000000246
Nov 26 10:27:32 ltsp-1 kernel: FS: 00007ff82d9ff700(0000) GS:ffff88003d740000(0000) knlGS:0000000000000000
Nov 26 10:27:32 ltsp-1 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 26 10:27:32 ltsp-1 kernel: CR2: 00007f11f9c3c008 CR3: 0000000550b51000 CR4: 00000000000007e0
Nov 26 10:27:32 ltsp-1 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Nov 26 10:27:32 ltsp-1 kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Nov 26 10:27:32 ltsp-1 kernel: Process mozStorage #5 (pid: 23225, threadinfo ffff88049de4c000, task ffff8802f99da080)
Nov 26 10:27:32 ltsp-1 kernel: Stack:
Nov 26 10:27:32 ltsp-1 kernel: ffff88055815f2f0 0000000000000000 0000000000000000 ffff8802f99da080
Nov 26 10:27:32 ltsp-1 kernel: ffffffff8109b320 ffff8800280347c8 ffff8800280347c8 0000000000000000
Nov 26 10:27:32 ltsp-1 kernel: 0000000000000000 ffff880628a0aa40 0000000000000006 ffff88031b9b9ef8
Nov 26 10:27:32 ltsp-1 kernel: Call Trace:
Nov 26 10:27:32 ltsp-1 kernel: [] ? wake_bit_function+0x0/0x50
Nov 26 10:27:32 ltsp-1 kernel: [] ? do_unlk+0x60/0xd0 [nfs]
Nov 26 10:27:32 ltsp-1 kernel: [] ? nfs_lock+0xfe/0x1d0 [nfs]
Nov 26 10:27:32 ltsp-1 kernel: [] ? vfs_lock_file+0x23/0x40
Nov 26 10:27:32 ltsp-1 kernel: [] ? fcntl_setlk+0x177/0x320
Nov 26 10:27:32 ltsp-1 kernel: [] ? audit_syscall_entry+0x1d7/0x200
NoNov 26 10:27:32 ltsp-1 kernel: [] ? sys_fcntl+0x197/0x530
Nov 26 10:27:32 ltsp-1 kernel: [] ? tracesys+0xd9/0xde
Nov 26 10:27:32 ltsp-1 kernel: Code: b3 09 81 65 48 8b 14 25 c0 cb 00 00 48 89 45 b8 48 89 55 a8 48 89 45 c0 0f 1f 00 ba 82 00 00 00 4c 89 ee 4c 89 e7 e8 f8 b9 ce e0 80 0b 01 8b 43 08 85 c0 74 12 48 89 df e8 95 63 ff ff 41 89
Nov 26 10:27:32 ltsp-1 kernel: Call Trace:
Nov 26 10:27:32 ltsp-1 kernel: [] ? nfs_iocounter_wait+0xa8/0xe0 [nfs]
Nov 26 10:27:32 ltsp-1 kernel: [] ? wake_bit_function+0x0/0x50
Nov 26 10:27:32 ltsp-1 kernel: [] ? do_unlk+0x60/0xd0 [nfs]
Nov 26 10:27:32 ltsp-1 kernel: [] ? nfs_lock+0xfe/0x1d0 [nfs]
Nov 26 10:27:32 ltsp-1 kernel: [] ? vfs_lock_file+0x23/0x40
Nov 26 10:27:32 ltsp-1 kernel: [] ? fcntl_setlk+0x177/0x320
Nov 26 10:27:32 ltsp-1 kernel: [] ? audit_syscall_entry+0x1d7/0x200
Nov 26 10:27:32 ltsp-1 kernel: [] ? ftrace_raw_event_sys_enter+0xd9/0x130
Nov 26 10:27:32 ltsp-1 kernel: [] ? sys_fcntl+0x197/0x530
Nov 26 10:27:32 ltsp-1 kernel: [] ? tracesys+0xd9/0xde
Nov 26 10:27:32 ltsp-1 kernel: [] ? ftrace_raw_event_sys_enter+0xd9/0x130

ID

Responses