soft lockup at osc_teardown_async_page
Issue
- soft lockup occurs at osc_teardown_async_page.
kernel: BUG: soft lockup - CPU#7 stuck for 67s! [kswapd1:139]
kernel: Modules linked in: mgc(U) lustre(U) lov(U) mdc(U) lquota(U) osc(U) ko2iblnd(U) ptlrpc(U) obdclass(U) lnet(U) lvfs(U) libcfs(U) nfsd expor
tfs 8021q garp stp llc mptctl mptbase nfs lockd fscache auth_rpcgss nfs_acl sunrpc smbus(U) ipmi_devintf nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack iptabl
e_filter ip_tables rdma_ucm(U) rdma_cm(U) iw_cm(U) ib_addr(U) ib_ipoib(U) ib_cm(U) ib_sa(U) ipv6 ib_uverbs(U) ib_umad(U) mlx4_ib(U) ib_mad(U) ib_core(U) mlx4_en(U) ml
x4_core(U) vhost_net macvtap macvlan tun kvm_intel kvm uinput power_meter ixgbe(U) sg microcode i2c_i801 i2c_core iTCO_wdt iTCO_vendor_support osst st igb dca ptp pps
_core shpchp ext4 mbcache jbd2 sr_mod cdrom lpfc scsi_transport_fc scsi_tgt sd_mod crc_t10dif usb_storage pata_acpi ata_generic ata_piix megaraid_sas dm_mirror dm_reg
ion_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
kernel: CPU 7
kernel:
kernel: Pid: 139, comm: kswapd1 Not tainted 2.6.32-358.el6.x86_64 #1 FUJITSU-SV PRIMERGY RX300 S6 /D2619
kernel: RIP: 0010:[<ffffffff8150ffce>] [<ffffffff8150ffce>] _spin_lock+0x1e/0x30
kernel: RSP: 0018:ffff8806343f1950 EFLAGS: 00000297
kernel: RAX: 000000000000fa69 RBX: ffff8806343f1950 RCX: ffff880c155c4be0
kernel: RDX: 000000000000fa68 RSI: ffff880c112ff0c0 RDI: ffff880c114a2a9c
kernel: RBP: ffffffff8100bb8e R08: 0000000000000002 R09: 0000000000000002
kernel: R10: ffffea002233cfc0 R11: 0000000000000003 R12: ffff8806343f1a10
kernel: R13: 0000000000000001 R14: ffffea00276086f8 R15: ffffea0027608720
kernel: FS: 0000000000000000(0000) GS:ffff880655440000(0000) knlGS:0000000000000000
kernel: CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
kernel: CR2: 00007f11d41f14b0 CR3: 0000000001a85000 CR4: 00000000000007e0
kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
kernel: Process kswapd1 (pid: 139, threadinfo ffff8806343f0000, task ffff8806343baaa0)
kernel: Stack:
kernel: ffff8806343f19f0 ffffffffa087adbf ffffea00276086c0 ffffea00276086f8
kernel: <d> ffffea00268c8520 ffffea00268c8558 ffffea00268c8590 ffffea00268c85c8
kernel: <d> ffff8806343f1a70 ffffffffa0997f81 ffffea0027608570 ffffea00276085a8
kernel: Call Trace:
kernel: [<ffffffffa087adbf>] ? osc_teardown_async_page+0x11f/0x480 [osc]
kernel: [<ffffffffa0997f81>] ? llap_from_page_with_lockh.clone.8+0xa1/0x1120 [lustre]
kernel: [<ffffffffa0905d3e>] ? lov_teardown_async_page+0x12e/0x530 [lov]
kernel: [<ffffffff81130336>] ? __pagevec_release+0x26/0x40
kernel: [<ffffffff811329f8>] ? move_active_pages_to_lru+0x178/0x1c0
kernel: [<ffffffffa09998e5>] ? ll_removepage+0x245/0x8d0 [lustre]
kernel: [<ffffffff8127c321>] ? radix_tree_gang_lookup_slot+0x81/0xf0
kernel: [<ffffffffa09b4df6>] ? ll_releasepage+0x16/0x20 [lustre]
kernel: [<ffffffff81118fc0>] ? try_to_release_page+0x30/0x60
kernel: [<ffffffff8113059e>] ? invalidate_inode_page+0x8e/0xb0
kernel: [<ffffffff811308ae>] ? invalidate_mapping_pages+0x12e/0x1e0
kernel: [<ffffffff81133ac6>] ? shrink_mem_cgroup_zone+0x376/0x610
kernel: [<ffffffff810c64f7>] ? css_get_next+0x87/0xe0
kernel: [<ffffffff8119d37b>] ? shrink_icache_memory+0x29b/0x2e0
kernel: [<ffffffff81131e2a>] ? shrink_slab+0x12a/0x1a0
kernel: [<ffffffff8113501a>] ? balance_pgdat+0x59a/0x820
kernel: [<ffffffff811353d4>] ? kswapd+0x134/0x3c0
kernel: [<ffffffff81096c80>] ? autoremove_wake_function+0x0/0x40
kernel: [<ffffffff811352a0>] ? kswapd+0x0/0x3c0
kernel: [<ffffffff81096916>] ? kthread+0x96/0xa0
kernel: [<ffffffff8100c0ca>] ? child_rip+0xa/0x20
kernel: [<ffffffff81096880>] ? kthread+0x0/0xa0
kernel: [<ffffffff8100c0c0>] ? child_rip+0x0/0x20
kernel: Code: 00 00 00 01 74 05 e8 b2 33 d7 ff c9 c3 55 48 89 e5 0f 1f 44 00 00 b8 00 00 01 00 f0 0f c1 07 0f b7 d0 c1 e8 10 39 c2 74 0e f3 90 <0f> b7 17 eb f5 83 3f 00 75 f4 eb df c9 c3 0f 1f 40 00 55 48 89
Environment
- Red Hat Enterprise Linux 6
- Luster (provided by 3rd party)
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.