soft lockup at osc_teardown_async_page
Issue
- soft lockup occurs at osc_teardown_async_page.
kernel: BUG: soft lockup - CPU#7 stuck for 67s! [kswapd1:139]
kernel: Modules linked in: mgc(U) lustre(U) lov(U) mdc(U) lquota(U) osc(U) ko2iblnd(U) ptlrpc(U) obdclass(U) lnet(U) lvfs(U) libcfs(U) nfsd expor
tfs 8021q garp stp llc mptctl mptbase nfs lockd fscache auth_rpcgss nfs_acl sunrpc smbus(U) ipmi_devintf nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack iptabl
e_filter ip_tables rdma_ucm(U) rdma_cm(U) iw_cm(U) ib_addr(U) ib_ipoib(U) ib_cm(U) ib_sa(U) ipv6 ib_uverbs(U) ib_umad(U) mlx4_ib(U) ib_mad(U) ib_core(U) mlx4_en(U) ml
x4_core(U) vhost_net macvtap macvlan tun kvm_intel kvm uinput power_meter ixgbe(U) sg microcode i2c_i801 i2c_core iTCO_wdt iTCO_vendor_support osst st igb dca ptp pps
_core shpchp ext4 mbcache jbd2 sr_mod cdrom lpfc scsi_transport_fc scsi_tgt sd_mod crc_t10dif usb_storage pata_acpi ata_generic ata_piix megaraid_sas dm_mirror dm_reg
ion_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
kernel: CPU 7
kernel:
kernel: Pid: 139, comm: kswapd1 Not tainted 2.6.32-358.el6.x86_64 #1 FUJITSU-SV PRIMERGY RX300 S6 /D2619
kernel: RIP: 0010:[<ffffffff8150ffce>] [<ffffffff8150ffce>] _spin_lock+0x1e/0x30
kernel: RSP: 0018:ffff8806343f1950 EFLAGS: 00000297
kernel: RAX: 000000000000fa69 RBX: ffff8806343f1950 RCX: ffff880c155c4be0
kernel: RDX: 000000000000fa68 RSI: ffff880c112ff0c0 RDI: ffff880c114a2a9c
kernel: RBP: ffffffff8100bb8e R08: 0000000000000002 R09: 0000000000000002
kernel: R10: ffffea002233cfc0 R11: 0000000000000003 R12: ffff8806343f1a10
kernel: R13: 0000000000000001 R14: ffffea00276086f8 R15: ffffea0027608720
kernel: FS: 0000000000000000(0000) GS:ffff880655440000(0000) knlGS:0000000000000000
kernel: CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
kernel: CR2: 00007f11d41f14b0 CR3: 0000000001a85000 CR4: 00000000000007e0
kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
kernel: Process kswapd1 (pid: 139, threadinfo ffff8806343f0000, task ffff8806343baaa0)
kernel: Stack:
kernel: ffff8806343f19f0 ffffffffa087adbf ffffea00276086c0 ffffea00276086f8
kernel: <d> ffffea00268c8520 ffffea00268c8558 ffffea00268c8590 ffffea00268c85c8
kernel: <d> ffff8806343f1a70 ffffffffa0997f81 ffffea0027608570 ffffea00276085a8
kernel: Call Trace:
kernel: [<ffffffffa087adbf>] ? osc_teardown_async_page+0x11f/0x480 [osc]
kernel: [<ffffffffa0997f81>] ? llap_from_page_with_lockh.clone.8+0xa1/0x1120 [lustre]
kernel: [<ffffffffa0905d3e>] ? lov_teardown_async_page+0x12e/0x530 [lov]
kernel: [<ffffffff81130336>] ? __pagevec_release+0x26/0x40
kernel: [<ffffffff811329f8>] ? move_active_pages_to_lru+0x178/0x1c0
kernel: [<ffffffffa09998e5>] ? ll_removepage+0x245/0x8d0 [lustre]
kernel: [<ffffffff8127c321>] ? radix_tree_gang_lookup_slot+0x81/0xf0
kernel: [<ffffffffa09b4df6>] ? ll_releasepage+0x16/0x20 [lustre]
kernel: [<ffffffff81118fc0>] ? try_to_release_page+0x30/0x60
kernel: [<ffffffff8113059e>] ? invalidate_inode_page+0x8e/0xb0
kernel: [<ffffffff811308ae>] ? invalidate_mapping_pages+0x12e/0x1e0
kernel: [<ffffffff81133ac6>] ? shrink_mem_cgroup_zone+0x376/0x610
kernel: [<ffffffff810c64f7>] ? css_get_next+0x87/0xe0
kernel: [<ffffffff8119d37b>] ? shrink_icache_memory+0x29b/0x2e0
kernel: [<ffffffff81131e2a>] ? shrink_slab+0x12a/0x1a0
kernel: [<ffffffff8113501a>] ? balance_pgdat+0x59a/0x820
kernel: [<ffffffff811353d4>] ? kswapd+0x134/0x3c0
kernel: [<ffffffff81096c80>] ? autoremove_wake_function+0x0/0x40
kernel: [<ffffffff811352a0>] ? kswapd+0x0/0x3c0
kernel: [<ffffffff81096916>] ? kthread+0x96/0xa0
kernel: [<ffffffff8100c0ca>] ? child_rip+0xa/0x20
kernel: [<ffffffff81096880>] ? kthread+0x0/0xa0
kernel: [<ffffffff8100c0c0>] ? child_rip+0x0/0x20
kernel: Code: 00 00 00 01 74 05 e8 b2 33 d7 ff c9 c3 55 48 89 e5 0f 1f 44 00 00 b8 00 00 01 00 f0 0f c1 07 0f b7 d0 c1 e8 10 39 c2 74 0e f3 90 <0f> b7 17 eb f5 83 3f 00 75 f4 eb df c9 c3 0f 1f 40 00 55 48 89
Environment
- Red Hat Enterprise Linux 6
- Luster (provided by 3rd party)
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
