Kernel panic or hang at kernel BUG at net/core/skbuff.c:132 when interface slave removal from infiniband's bond in Red Hat Enterprise Linux.

Solution Unverified - Updated -

Issue

[2488273.518990] bond0: Removing slave ib0
[2488273.524763] bond0: Releasing active interface ib0
[2488273.524782] bond0: making interface ib1 the new active one
[2488273.629378] bond0: Removing slave ib1
[2488273.646768] bond0: Releasing active interface ib1
[2488273.657813] bond0: last VLAN challenged slave ib1 left bond bond0 - VLAN blocking is removed
[2488273.659870] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe405e000 data:ffff880fe405dff8 tail:0x48 end:0xc0 dev:bond0
[2488273.659887] ------------[ cut here ]------------
[2488273.659888] kernel BUG at net/core/skbuff.c:132!
[2488273.659890] invalid opcode: 0000 [#1] PREEMPT SMP 
[2488273.659908] Modules linked in: cls_u32 sch_netem sch_prio xt_comment iptable_filter ip_tables autofs4 bonding ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm configfs ib_cm iw_cm ext2 vfat fat dm_multipath iTCO_wdt iTCO_vendor_support pcspkr sb_edac edac_core tg3 hpilo hpwdt sg i2c_i801 lpc_ich ipmi_si ipmi_msghandler ioatdma dca acpi_power_meter hwmon ext4 jbd2 mbcache sr_mod cdrom sd_mod crc_t10dif crct10dif_common ahci libahci qla2xxx scsi_transport_fc mlx4_ib mlx4_en ib_core ipv6 ptp pps_core mlx4_core hpsa scsi_transport_sas wmi ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
[2488273.659910] CPU: 10 PID: 12399 Comm: python Not tainted 3.10.0-514.rt56.215.el6rt.x86_64 #1
[2488273.659910] Hardware name: HP ProLiant DL380 Gen9, BIOS P89 07/20/2015
[2488273.659911] task: ffff8819d02919b0 ti: ffff8819d8a64000 task.ti: ffff8819d8a64000
[2488273.659916] RIP: 0010:[<ffffffff81529fe5>]  [<ffffffff81529fe5>] skb_push+0x85/0x90
[2488273.659917] RSP: 0018:ffff8819d8a676a8  EFLAGS: 00010286
[2488273.659917] RAX: 0000000000000085 RBX: ffff8800780ace00 RCX: 0000000000000000
[2488273.659917] RDX: 0000000000000001 RSI: 0000000000000009 RDI: ffff8819d8a64000
[2488273.659918] RBP: ffff8819d8a676c8 R08: ff7597796c7c5dca R09: ffffffff81bb5979
[2488273.659918] R10: 0000000000000000 R11: 0000000000020000 R12: ffff880fe4846300
[2488273.659918] R13: 0000000000000608 R14: ffff880fe4846300 R15: ffff880fe41f3370
[2488273.659919] FS:  00007efd1ac61700(0000) GS:ffff88103fd80000(0000) knlGS:0000000000000000
[2488273.659920] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[2488273.659920] CR2: ffffffffff600400 CR3: 0000001ff3771000 CR4: 00000000001407e0
[2488273.659921] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[2488273.659921] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[2488273.659922] Stack:
[2488273.659923]  ffff880fe405dff8 0000000000000048 00000000000000c0 ffff880fe4846000
[2488273.659924]  ffff8819d8a676f8 ffffffffa053bc08 ffff880fe4846000 ffff880fe4846000
[2488273.659924]  ffff8800780ace00 ffff880fe405e010 ffff8819d8a67748 ffffffff815be02e
[2488273.659924] Call Trace:
[2488273.659929]  [<ffffffffa053bc08>] ipoib_hard_header+0x48/0x80 [ib_ipoib]
[2488273.659931]  [<ffffffff815be02e>] arp_create+0x12e/0x240
[2488273.659931]  [<ffffffff815be95e>] arp_send_dst+0x3e/0x70
[2488273.659932]  [<ffffffff815bf2f7>] arp_solicit+0x137/0x310
[2488273.659934]  [<ffffffff8152b5c3>] ? skb_copy_bits+0x63/0x260
[2488273.659935]  [<ffffffff8152a798>] ? __alloc_skb+0xa8/0x1e0
[2488273.659936]  [<ffffffff81529457>] ? copy_skb_header+0x17/0xa0
[2488273.659938]  [<ffffffff8154949f>] neigh_probe+0x4f/0x70
[2488273.659939]  [<ffffffff815495ba>] __neigh_event_send+0xfa/0x270
[2488273.659941]  [<ffffffff8154be7b>] neigh_resolve_output+0x15b/0x200
[2488273.659942]  [<ffffffff8158e00e>] ip_finish_output2+0x23e/0x3e0
[2488273.659944]  [<ffffffff81572d58>] ? nf_iterate+0x88/0xb0
[2488273.659945]  [<ffffffff8158f978>] ip_finish_output+0x118/0x130
[2488273.659946]  [<ffffffff8158fc8b>] ip_output+0xab/0xc0
[2488273.659947]  [<ffffffff8158ddc1>] ? __ip_local_out+0xc1/0xd0
[2488273.659948]  [<ffffffff8158e1eb>] ip_local_out_sk+0x3b/0x50
[2488273.659949]  [<ffffffff8158f183>] ip_queue_xmit+0x153/0x3b0
[2488273.659951]  [<ffffffff815a7987>] tcp_transmit_skb+0x497/0x820
[2488273.659952]  [<ffffffff815a9819>] tcp_write_xmit+0x209/0x7d0
[2488273.659953]  [<ffffffff8152a798>] ? __alloc_skb+0xa8/0x1e0
[2488273.659954]  [<ffffffff815aa3b2>] __tcp_push_pending_frames+0x32/0xd0
[2488273.659955]  [<ffffffff81596d8e>] tcp_push+0xee/0x120
[2488273.659956]  [<ffffffff8159a8c5>] tcp_sendmsg+0x115/0xc30
[2488273.659958]  [<ffffffff815c728d>] inet_sendmsg+0x8d/0xd0
[2488273.659960]  [<ffffffff81521936>] sock_sendmsg+0xa6/0xd0
[2488273.659964]  [<ffffffff811dc0e7>] ? fget_light+0x97/0xf0
[2488273.659965]  [<ffffffff81521a94>] SYSC_sendto+0x134/0x180
[2488273.659967]  [<ffffffff810a4b66>] ? migrate_disable+0x76/0x110
[2488273.659969]  [<ffffffff811d12f5>] ? do_vfs_ioctl+0x245/0x390
[2488273.659970]  [<ffffffff81521aee>] SyS_sendto+0xe/0x10
[2488273.659973]  [<ffffffff81629b72>] system_call_fastpath+0x16/0x1b
[2488273.659981] Code: 97 dc 00 00 00 48 89 54 24 10 8b bf d8 00 00 00 48 8b 55 08 48 89 04 24 31 c0 48 89 7c 24 08 48 c7 c7 98 7e 8c 81 e8 cf 3c 0f 00 <0f> 0b eb fe 0f 1f 80 00 00 00 00 55 48 89 e5 48 83 ec 20 0f 1f 
[2488273.659982] RIP  [<ffffffff81529fe5>] skb_push+0x85/0x90
[2488273.659983]  RSP <ffff8819d8a676a8>
[2488273.683402] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe4ec9e00 data:ffff880fe4ec9df8 tail:0x48 end:0xc0 dev:bond0
[2488273.694879] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe4f36c00 data:ffff880fe4f36bf8 tail:0x48 end:0xc0 dev:bond0
[2488273.699081] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe4fdfe00 data:ffff880fe4fdfdf8 tail:0x48 end:0xc0 dev:bond0
[2488273.725864] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe2554000 data:ffff880fe2553ff8 tail:0x48 end:0xc0 dev:bond0

Environment

  • Red Hat Enterprise Linux 7
  • Red Hat Enterprise Linux MRG 2.5

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content