Kernel panic or hang at kernel BUG at net/core/skbuff.c:132 when interface slave removal from infiniband's bond in Red Hat Enterprise Linux.
Issue
[2488273.518990] bond0: Removing slave ib0
[2488273.524763] bond0: Releasing active interface ib0
[2488273.524782] bond0: making interface ib1 the new active one
[2488273.629378] bond0: Removing slave ib1
[2488273.646768] bond0: Releasing active interface ib1
[2488273.657813] bond0: last VLAN challenged slave ib1 left bond bond0 - VLAN blocking is removed
[2488273.659870] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe405e000 data:ffff880fe405dff8 tail:0x48 end:0xc0 dev:bond0
[2488273.659887] ------------[ cut here ]------------
[2488273.659888] kernel BUG at net/core/skbuff.c:132!
[2488273.659890] invalid opcode: 0000 [#1] PREEMPT SMP
[2488273.659908] Modules linked in: cls_u32 sch_netem sch_prio xt_comment iptable_filter ip_tables autofs4 bonding ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm configfs ib_cm iw_cm ext2 vfat fat dm_multipath iTCO_wdt iTCO_vendor_support pcspkr sb_edac edac_core tg3 hpilo hpwdt sg i2c_i801 lpc_ich ipmi_si ipmi_msghandler ioatdma dca acpi_power_meter hwmon ext4 jbd2 mbcache sr_mod cdrom sd_mod crc_t10dif crct10dif_common ahci libahci qla2xxx scsi_transport_fc mlx4_ib mlx4_en ib_core ipv6 ptp pps_core mlx4_core hpsa scsi_transport_sas wmi ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
[2488273.659910] CPU: 10 PID: 12399 Comm: python Not tainted 3.10.0-514.rt56.215.el6rt.x86_64 #1
[2488273.659910] Hardware name: HP ProLiant DL380 Gen9, BIOS P89 07/20/2015
[2488273.659911] task: ffff8819d02919b0 ti: ffff8819d8a64000 task.ti: ffff8819d8a64000
[2488273.659916] RIP: 0010:[<ffffffff81529fe5>] [<ffffffff81529fe5>] skb_push+0x85/0x90
[2488273.659917] RSP: 0018:ffff8819d8a676a8 EFLAGS: 00010286
[2488273.659917] RAX: 0000000000000085 RBX: ffff8800780ace00 RCX: 0000000000000000
[2488273.659917] RDX: 0000000000000001 RSI: 0000000000000009 RDI: ffff8819d8a64000
[2488273.659918] RBP: ffff8819d8a676c8 R08: ff7597796c7c5dca R09: ffffffff81bb5979
[2488273.659918] R10: 0000000000000000 R11: 0000000000020000 R12: ffff880fe4846300
[2488273.659918] R13: 0000000000000608 R14: ffff880fe4846300 R15: ffff880fe41f3370
[2488273.659919] FS: 00007efd1ac61700(0000) GS:ffff88103fd80000(0000) knlGS:0000000000000000
[2488273.659920] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[2488273.659920] CR2: ffffffffff600400 CR3: 0000001ff3771000 CR4: 00000000001407e0
[2488273.659921] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[2488273.659921] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[2488273.659922] Stack:
[2488273.659923] ffff880fe405dff8 0000000000000048 00000000000000c0 ffff880fe4846000
[2488273.659924] ffff8819d8a676f8 ffffffffa053bc08 ffff880fe4846000 ffff880fe4846000
[2488273.659924] ffff8800780ace00 ffff880fe405e010 ffff8819d8a67748 ffffffff815be02e
[2488273.659924] Call Trace:
[2488273.659929] [<ffffffffa053bc08>] ipoib_hard_header+0x48/0x80 [ib_ipoib]
[2488273.659931] [<ffffffff815be02e>] arp_create+0x12e/0x240
[2488273.659931] [<ffffffff815be95e>] arp_send_dst+0x3e/0x70
[2488273.659932] [<ffffffff815bf2f7>] arp_solicit+0x137/0x310
[2488273.659934] [<ffffffff8152b5c3>] ? skb_copy_bits+0x63/0x260
[2488273.659935] [<ffffffff8152a798>] ? __alloc_skb+0xa8/0x1e0
[2488273.659936] [<ffffffff81529457>] ? copy_skb_header+0x17/0xa0
[2488273.659938] [<ffffffff8154949f>] neigh_probe+0x4f/0x70
[2488273.659939] [<ffffffff815495ba>] __neigh_event_send+0xfa/0x270
[2488273.659941] [<ffffffff8154be7b>] neigh_resolve_output+0x15b/0x200
[2488273.659942] [<ffffffff8158e00e>] ip_finish_output2+0x23e/0x3e0
[2488273.659944] [<ffffffff81572d58>] ? nf_iterate+0x88/0xb0
[2488273.659945] [<ffffffff8158f978>] ip_finish_output+0x118/0x130
[2488273.659946] [<ffffffff8158fc8b>] ip_output+0xab/0xc0
[2488273.659947] [<ffffffff8158ddc1>] ? __ip_local_out+0xc1/0xd0
[2488273.659948] [<ffffffff8158e1eb>] ip_local_out_sk+0x3b/0x50
[2488273.659949] [<ffffffff8158f183>] ip_queue_xmit+0x153/0x3b0
[2488273.659951] [<ffffffff815a7987>] tcp_transmit_skb+0x497/0x820
[2488273.659952] [<ffffffff815a9819>] tcp_write_xmit+0x209/0x7d0
[2488273.659953] [<ffffffff8152a798>] ? __alloc_skb+0xa8/0x1e0
[2488273.659954] [<ffffffff815aa3b2>] __tcp_push_pending_frames+0x32/0xd0
[2488273.659955] [<ffffffff81596d8e>] tcp_push+0xee/0x120
[2488273.659956] [<ffffffff8159a8c5>] tcp_sendmsg+0x115/0xc30
[2488273.659958] [<ffffffff815c728d>] inet_sendmsg+0x8d/0xd0
[2488273.659960] [<ffffffff81521936>] sock_sendmsg+0xa6/0xd0
[2488273.659964] [<ffffffff811dc0e7>] ? fget_light+0x97/0xf0
[2488273.659965] [<ffffffff81521a94>] SYSC_sendto+0x134/0x180
[2488273.659967] [<ffffffff810a4b66>] ? migrate_disable+0x76/0x110
[2488273.659969] [<ffffffff811d12f5>] ? do_vfs_ioctl+0x245/0x390
[2488273.659970] [<ffffffff81521aee>] SyS_sendto+0xe/0x10
[2488273.659973] [<ffffffff81629b72>] system_call_fastpath+0x16/0x1b
[2488273.659981] Code: 97 dc 00 00 00 48 89 54 24 10 8b bf d8 00 00 00 48 8b 55 08 48 89 04 24 31 c0 48 89 7c 24 08 48 c7 c7 98 7e 8c 81 e8 cf 3c 0f 00 <0f> 0b eb fe 0f 1f 80 00 00 00 00 55 48 89 e5 48 83 ec 20 0f 1f
[2488273.659982] RIP [<ffffffff81529fe5>] skb_push+0x85/0x90
[2488273.659983] RSP <ffff8819d8a676a8>
[2488273.683402] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe4ec9e00 data:ffff880fe4ec9df8 tail:0x48 end:0xc0 dev:bond0
[2488273.694879] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe4f36c00 data:ffff880fe4f36bf8 tail:0x48 end:0xc0 dev:bond0
[2488273.699081] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe4fdfe00 data:ffff880fe4fdfdf8 tail:0x48 end:0xc0 dev:bond0
[2488273.725864] skbuff: skb_under_panic: text:ffffffffa053bc08 len:80 put:20 head:ffff880fe2554000 data:ffff880fe2553ff8 tail:0x48 end:0xc0 dev:bond0
Environment
- Red Hat Enterprise Linux 7
- Red Hat Enterprise Linux MRG 2.5
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.