Server panics with NULL pointer dereference in fnic driver

Solution In Progress - Updated -

Issue

Server panics and leaves a vmcore or dmesg output indicating a NULL pointer dereference such as the following:

<1>BUG: unable to handle kernel NULL pointer dereference at (null)
<1>IP: [<ffffffffa00b1065>] fnic_queuecommand+0x555/0x960 [fnic]
<4>PGD 4012895067 PUD 2a82161067 PMD 0 
<4>Oops: 0000 [#1] SMP 
<4>last sysfs file: /sys/module/ipv6/initstate
<4>CPU 28 
<4>Modules linked in: bridge ktap_57730(U) oracleacfs(P)(U) oracleadvm(P)(U) oracleoks(P)(U) nfs lockd fscache auth_rpcgss nfs_acl sunrpc cpufreq_ondemand acpi_cpufreq freq_table mperf bonding 8021q garp stp llc ipv6 iTCO_wdt iTCO_vendor_support microcode i2c_i801 i2c_core lpc_ich mfd_core i7core_edac edac_core sg enic(U) power_meter shpchp ext4 jbd2 mbcache dm_round_robin sd_mod crc_t10dif fnic(U) libfcoe libfc scsi_transport_fc scsi_tgt megaraid_sas dm_multipath dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]
<4>
<4>Pid: 22302, comm: oracle Tainted: P           ---------------    2.6.32-431.17.1.el6.x86_64 #1 Cisco Systems Inc B230-BASE-M2/B230-BASE-M2
<4>RIP: 0010:[<ffffffffa00b1065>]  [<ffffffffa00b1065>] fnic_queuecommand+0x555/0x960 [fnic]
<4>RSP: 0018:ffff8830d8c67828  EFLAGS: 00010002
<4>RAX: 0000000000000000 RBX: ffff88402069ca50 RCX: 0000000000002710
<4>RDX: 0000000000000002 RSI: 0000000000000056 RDI: 0000000000000056
<4>RBP: ffff8830d8c678d8 R08: 0000000000000000 R09: 0000000000000000
<4>R10: 0000000000000001 R11: 000000000000000a R12: ffff88309172f380
<4>R13: ffff88402069c000 R14: ffff8822b2338a40 R15: 0000000000000000
<4>FS:  00007f1e9f601700(0000) GS:ffff880193840000(0000) knlGS:0000000000000000
<4>CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4>CR2: 0000000000000000 CR3: 00000030dd459000 CR4: 00000000000007e0
<4>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<4>DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
<4>Process oracle (pid: 22302, threadinfo ffff8830d8c66000, task ffff8840217d0ae0)
<4>Stack:
<4> ffff884016f44380 ffff884016f44380 ffff888022b582f8 ffff884016f44380
<4><d> ffff8830d8c678d8 ffffffffa00cdea1 ffff8830d8c67868 ffffffff00096300
<4><d> 0000271000000800 ffff8880000007d0 0000000000000056 ffff88402069d448
<4>Call Trace:
<4> [<ffffffffa00cdea1>] ? sd_prep_fn+0x81/0xf30 [sd_mod]
<4> [<ffffffff81380095>] scsi_dispatch_cmd+0xe5/0x310
<4> [<ffffffff813889ee>] scsi_request_fn+0x5ee/0x7a0
<4> [<ffffffff812656e1>] __blk_run_queue+0x31/0x40
<4> [<ffffffff81260b8a>] elv_insert+0xfa/0x190
<4> [<ffffffff81260c60>] __elv_add_request+0x40/0x90
<4> [<ffffffff812650cd>] blk_insert_cloned_request+0x7d/0xc0
<4> [<ffffffffa00022fc>] dm_dispatch_request+0x3c/0x70 [dm_mod]
<4> [<ffffffffa0003a92>] dm_request_fn+0x172/0x2e0 [dm_mod]
<4> [<ffffffff81260bb0>] ? elv_insert+0x120/0x190
<4> [<ffffffff81265882>] __generic_unplug_device+0x32/0x40
<4> [<ffffffff81267ad8>] blk_queue_bio+0x1b8/0x620
<4> [<ffffffffa00036f5>] dm_request+0x155/0x1a0 [dm_mod]
<4> [<ffffffff81266a40>] generic_make_request+0x240/0x5a0
<4> [<ffffffff81121d45>] ? mempool_alloc_slab+0x15/0x20
<4> [<ffffffff81121ee3>] ? mempool_alloc+0x63/0x140
<4> [<ffffffff81266e10>] submit_bio+0x70/0x120
<4> [<ffffffff8126b635>] __blkdev_issue_flush+0xa5/0xe0
<4> [<ffffffff8126b686>] blkdev_issue_flush+0x16/0x20
<4> [<ffffffff811c52af>] blkdev_fsync+0x3f/0x70
<4> [<ffffffff811ba6f1>] vfs_fsync_range+0xa1/0x100
<4> [<ffffffff811ba79b>] generic_write_sync+0x4b/0x50
<4> [<ffffffff811c45de>] blkdev_aio_write+0x7e/0xa0
<4> [<ffffffff811c4560>] ? blkdev_aio_write+0x0/0xa0
<4> [<ffffffff811d4bf4>] aio_rw_vect_retry+0x84/0x200
<4> [<ffffffff811d65b4>] aio_run_iocb+0x64/0x170
<4> [<ffffffff811d79e1>] do_io_submit+0x291/0x920
<4> [<ffffffff811d8080>] sys_io_submit+0x10/0x20
<4> [<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
<4>Code: 7e 0e 48 8b 83 10 03 00 00 48 89 83 18 03 00 00 41 8b 84 24 c0 00 00 00 45 31 ff 83 c8 02 41 89 84 24 c0 00 00 00 49 8b 44 24 50 <44> 0f b6 00 0f b6 78 07 0f b6 70 08 0f b6 48 02 0f b6 50 03 44 
<1>RIP  [<ffffffffa00b1065>] fnic_queuecommand+0x555/0x960 [fnic]
<4> RSP <ffff8830d8c67828>
<4>CR2: 0000000000000000

Environment

Red Hat Enterprise Linux (RHEL) 5
Red Hat Enterprise Linux (RHEL) 6

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content