Kernel panic due to unsigned kernel module "oracleacfs"

Solution Verified - Updated -

Issue

  • Servers rebooted unexpectedly
  • Kernel panic with following call traces :

    BUG: unable to handle kernel paging request at ffffc9002ee7b000
    IP: [<ffffffffa080c397>] OfsZeroDiskRange+0xd57/0xff0 [oracleacfs]
    PGD 207feb9067 PUD 207feba067 PMD d77c02067 PTE 0
    Oops: 0000 [#1] SMP 
    last sysfs file: /sys/devices/virtual/net/bond0.38/carrier
    CPU 0 
    Modules linked in: bridge lin_tape(U) nfsd exportfs oracleacfs(P)(U) oracleadvm(P)(U) oracleoks(P)(U) oracleasm(U) autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc acpi_cpufreq freq_table mperf bonding 8021q garp stp llc ipv6 vfat fat iTCO_wdt iTCO_vendor_support microcode cdc_ether usbnet mii i2c_i801 i2c_core lpc_ich mfd_core shpchp osst st ipmi_si ipmi_msghandler sg be2net ext4 jbd2 mbcache dm_round_robin sd_mod mpt2sas scsi_transport_sas raid_class wmi lpfc(U) scsi_transport_fc scsi_tgt crc_t10dif dm_multipath dm_mirror dm_region_hash dm_log dm_mod [last unloaded: oracleoks]
    Pid: 6263, comm: oracle Tainted: P        W  ---------------    2.6.32-504.16.2.el6.x86_64 #1 IBM Flex System x240 Compute Node -[873715X]-/00AE643
    RIP: 0010:[<ffffffffa080c397>]  [<ffffffffa080c397>] OfsZeroDiskRange+0xd57/0xff0 [oracleacfs]
    RSP: 0018:ffff8805417abc78  EFLAGS: 00010206
    RAX: 000000000003f000 RBX: ffff880b1b4098c0 RCX: ffffc9002ee3c000
    RDX: ffffc9002ee3c000 RSI: 0000000000000001 RDI: ffff8820498a65e0
    RBP: ffff8805417abd18 R08: 00000000051fd798 R09: 000000000fd00037
    R10: 0000000000000068 R11: 000000000000089e R12: 0000000000000440
    R13: 0000000000000000 R14: 0000000000000008 R15: 0000000000000000
    FS:  00007f848f03d700(0000) GS:ffff88004c200000(0000) knlGS:0000000000000000
    CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
    CR2: ffffc9002ee7b000 CR3: 0000000a28eaf000 CR4: 00000000001407f0
    DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
    DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
    Process oracle (pid: 6263, threadinfo ffff8805417aa000, task ffff8802d348d520)
    Stack:
    ffff880d7b33a460 000000000bdc4000 0000000000004000 0000000000004000
    <d> ffff88031a532aa0 001000000bdc4000 000000000bdc0000 000000000bdc4000
    <d> 0000000000004000 ffffc9002eba3000 ffff8805417abd18 000000025c000000
    Call Trace:
    [<ffffffffa08ae817>] ofs_setattr+0x1c37/0x2490 [oracleacfs]
    [<ffffffff8122e9ef>] ? security_inode_permission+0x1f/0x30
    [<ffffffff811ad398>] notify_change+0x168/0x340
    [<ffffffff8118c3e4>] do_truncate+0x64/0xa0
    [<ffffffff8118c790>] sys_ftruncate+0x120/0x130
    [<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
    Code: 0a 10 48 39 c2 0f 85 cf fe ff ff 8b 43 24 48 c7 43 28 00 00 00 00 83 c0 01 4d 85 ed 89 43 24 75 76 48 8b 55 c0 89 c0 48 c1 e0 05 <48> 8b 04 10 48 89 43 18 e9 a2 fe ff ff 48 8d 47 30 66 ff 00 66 
    RIP  [<ffffffffa080c397>] OfsZeroDiskRange+0xd57/0xff0 [oracleacfs]
    RSP <ffff8805417abc78>
    CR2: ffffc9002ee7b000
    

    OR

    BUG: unable to handle kernel paging request at 0000000100000029  
    IP: [<ffffffffa0be37d0>] ofs_fcbtable_lookup+0x170/0xb30 [oracleacfs]
    Kernel PGD 80000024ab3f7067 PUD 0 
    User   PGD 24ab3f7067 PUD 0 
    Oops: 0000 [#1] SMP 
    last sysfs file: /sys/devices/virtual/net/bond0.395/carrier
    CPU 8 
    Modules linked in: falcon_lsm_serviceable(P)(U) falcon_nf_netcontain(P)(U) falcon_kal(U) falcon_lsm_pinned_12803(U) falcon_lsm_pinned_12704(U) falcon_lsm_pinned_12606(U) ip6table_filter ip6_tables iptable_filter ip_tables tcp_diag inet_diag falcon_lsm_pinned_12504(U) rds oracleacfs(P)(U) oracleadvm(P)(U) oracleoks(P)(U) lin_tape(U) pfo(U) nfsd exportfs oracleasm autofs4 bmhook(U) tmhook(U) dsa_filter(P)(U) dsa_filter_hook(U) nfs lockd fscache auth_rpcgss nfs_acl sunrpc cpufreq_ondemand acpi_cpufreq freq_table mperf 8021q garp stp llc falcon_lsm_pinned_12304(U) bonding ipv6 vfat fat iTCO_wdt iTCO_vendor_support microcode cdc_ether usbnet mii i2c_i801 i2c_core lpc_ich mfd_core shpchp osst st ipmi_si ipmi_msghandler sg ext4 jbd2 mbcache dm_round_robin sd_mod mpt2sas scsi_transport_sas raid_class lpfc(U) scsi_transport_fc scsi_tgt crc_t10dif be2net wmi dm_multipath dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal]
    Pid: 3135, comm: wscansw Tainted: P        W  -- ------------    2.6.32-754.41.2.el6.x86_64 #1 IBM Flex System x240 Compute Node -[873715X]-/00AE643
    RIP: 0010:[<ffffffffa0be37d0>]  [<ffffffffa0be37d0>] ofs_fcbtable_lookup+0x170/0xb30 [oracleacfs]
    RSP: 0018:ffff88138fd3b7e8  EFLAGS: 00010202
    RAX: 0000000000000072 RBX: 0000000100000001 RCX: 0000000000000000
    RDX: 00000000000001cc RSI: 0000000000000001 RDI: ffff88138fd3b9cc
    RBP: ffff88138fd3b8d8 R08: 0000000000003447 R09: 0000000000000011
    R10: 0000000000000000 R11: 0000000000000008 R12: ffff8828483c0000
    R13: 0000000000000001 R14: 00000000005318be R15: 000000000051f7ce
    FS:  00007f079600d720(0000) GS:ffff8801b9a00000(0000) knlGS:0000000000000000
    CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
    CR2: 0000000100000029 CR3: 000000280cf00000 CR4: 00000000001607e0
    DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
    DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
    Process wscansw (pid: 3135, threadinfo ffff88138fd38000, task ffff881b74bdd520)
    Stack:
    0000000000000000 0000000000000000 ffff881300000000 0000000000000000
    <d> ffff88138fd3b8b0 0000000000000202 ffff88138fd3b888 0000000000008120
    <d> ffff88226b3c7be0 ffff88138fd3b9d0 ffff8828483c2e60 0000000000000021
    Call Trace:
    [<ffffffffa09eaf7e>] ? KsLHHMRecFnAddInt+0x2e/0x220 [oracleoks]
    [<ffffffffa0c674fe>] OfsGenFindFcb+0x36e/0x2270 [oracleacfs]
    [<ffffffffa0c6965f>] OfsGenFindFile+0x25f/0xe10 [oracleacfs]  
    [<ffffffffa09d8cf5>] ? KsMalloc+0x105/0x170 [oracleoks]    
    [<ffffffffa0db5be0>] ofs_lookup+0x330/0xa10 [oracleacfs]   
    [<ffffffff811b2d3b>] do_lookup+0x1ab/0x230
    [<ffffffff811b38fc>] __link_path_walk+0x79c/0x1090
    [<ffffffff811b44aa>] path_walk+0x6a/0xe0
    [<ffffffff811b46bb>] filename_lookup+0x6b/0xc0
    [<ffffffff811b57e7>] user_path_at+0x57/0xa0
    [<ffffffff812a4ba5>] ? _atomic_dec_and_lock+0x55/0x80
    [<ffffffff811c5df0>] ? mntput_no_expire+0x30/0x110
    [<ffffffff810f1720>] ? audit_filter_rules+0x230/0xd80
    [<ffffffff811a8960>] vfs_fstatat+0x50/0xa0
    [<ffffffff811a8a1e>] vfs_lstat+0x1e/0x20
    [<ffffffff811a8a44>] sys_newlstat+0x24/0x50
    [<ffffffff810f4227>] ? audit_syscall_entry+0x1d7/0x200
    [<ffffffff815662c2>] ? system_call_after_swapgs+0xa2/0x152
    [<ffffffff815662ce>] ? system_call_after_swapgs+0xae/0x152
    [<ffffffff815662c2>] ? system_call_after_swapgs+0xa2/0x152
    [<ffffffff815662ce>] ? system_call_after_swapgs+0xae/0x152
    [<ffffffff815662c2>] ? system_call_after_swapgs+0xa2/0x152
    [<ffffffff815663a7>] system_call_fastpath+0x35/0x3a
    [<ffffffff815662ce>] ? system_call_after_swapgs+0xae/0x152
    Code: 90 45 89 e9 41 83 c9 10 89 07 48 8b 1b 48 85 db 75 19 e9 fd 01 00 00 0f 1f 40 00 48 8b 9b 80 03 00 00 48 85 db 0f 84 e9 01 00 00 <4c> 39 7b 28 75 ea 4c 39 63 10 75 e4 31 f6 83 bb 68 02 00 00 01 
    RIP  [<ffffffffa0be37d0>] ofs_fcbtable_lookup+0x170/0xb30 [oracleacfs]
    RSP <ffff88138fd3b7e8>
    CR2: 0000000100000029
    

Environment

  • Red Hat Enterprise Linux 6
  • oracleacfs

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content