RHEL6: kernel crash in __ext4_get_inode_loc - BUG: unable to handle kernel paging request at 000060e7a3807c90

Issue

• First we see orphan list check failed! message, then kernel crashed with the below message

<1>BUG: unable to handle kernel paging request at 000060e7a3807c90
<1>IP: [<ffffffffa04477da>] __ext4_get_inode_loc+0x11a/0x3b0 [ext4]
<4>PGD 0
<4>Oops: 0000 [#1] SMP
<4>last sysfs file: /sys/devices/pci0000:00/0000:00:0c.0/0000:0b:00.0/host8/rport-8:0-5/target8:0:5/8:0:5:1/state
<4>CPU 8
<4>Modules linked in: ext3 jbd dm_snapshot dm_bufio ipmi_si mpt2sas scsi_transport_sas raid_class mptctl mptbase dell_rbu autofs4 nfs lockd fscache auth_rpcgss nfs_acl sunrpc cpufreq_ondemand powernow_k8 freq_table mperf ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_tables ipv6 ampnetworkflow(U) ampavflt(U) redirfs(U) dm_round_robin dm_multipath ipmi_devintf ipmi_msghandler microcode bnx2 joydev dcdbas serio_raw k10temp amd64_edac_mod edac_core edac_mce_amd sg ses enclosure bnx2x ptp pps_core libcrc32c mdio i2c_piix4 shpchp ext4 jbd2 mbcache sr_mod cdrom sd_mod crc_t10dif qla2xxx scsi_transport_fc scsi_tgt megaraid_sas ata_generic pata_acpi sata_svw usb_storage radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ipmi_si]
<4>
<4>Pid: 17290, comm: postgres Not tainted 2.6.32-642.el6.x86_64 #1 Dell Inc. PowerEdge R905/0K552T
<4>RIP: 0010:[<ffffffffa04477da>]  [<ffffffffa04477da>] __ext4_get_inode_loc+0x11a/0x3b0 [ext4]
<4>RSP: 0018:ffff880862c77ac8  EFLAGS: 00010216
<4>RAX: 0000001c00000000 RBX: 000060e7a3807a00 RCX: 0000000000000034
<4>RDX: 0000000000000001 RSI: ffff880862c77ba8 RDI: ffff882032d28228
<4>RBP: ffff880862c77b38 R08: 1010000000000000 R09: efb2a6c7cf490202
<4>R10: ffff882033e44400 R11: 0000000000000000 R12: ffff880862c77ba8
<4>R13: ffff882032d28228 R14: ffff880862c77ba8 R15: ffff880862c77ba8
<4>FS:  00007f62e9a2b7c0(0000) GS:ffff880028280000(0000) knlGS:0000000000000000
<4>CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4>CR2: 000060e7a3807c90 CR3: 00000020335ab000 CR4: 00000000000007e0
<4>DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
<4>DR3: 0000000000000000 DR6: 00000000ffff4ff0 DR7: 0000000000000400
<4>Process postgres (pid: 17290, threadinfo ffff880862c74000, task ffff882032e1a040)
<4>Stack:
<4> ffff880386ad9b58 ffff88102f5d4408 ffff881e3a950dd8 0000000000000000
<4><d> ffff880862c77b08 ffffffffa042047c ffffffffa047e460 0000000186ad9b58
<4><d> ffff880862c77b48 ffff882032d28228 ffff880862c77ba8 ffff880386ad9b58
<4>Call Trace:
<4> [<ffffffffa042047c>] ? jbd2_journal_get_write_access+0x3c/0x50 [jbd2]
<4> [<ffffffffa0447b9c>] ext4_get_inode_loc+0x1c/0x20 [ext4]
<4> [<ffffffffa0447bcd>] ext4_reserve_inode_write+0x2d/0xa0 [ext4]
<4> [<ffffffffa044fd65>] ext4_orphan_del+0xd5/0x1f0 [ext4]
<4> [<ffffffffa0447cc3>] ? ext4_mark_inode_dirty+0x83/0x1d0 [ext4]
<4> [<ffffffffa044ccf0>] ? ext4_delete_inode+0x0/0x2e0 [ext4]
<4> [<ffffffffa044ccf0>] ? ext4_delete_inode+0x0/0x2e0 [ext4]
<4> [<ffffffffa044cf13>] ext4_delete_inode+0x223/0x2e0 [ext4]
<4> [<ffffffff811b830e>] generic_delete_inode+0xde/0x1d0
<4> [<ffffffff811b8465>] generic_drop_inode+0x65/0x80
<4> [<ffffffff811b72b2>] iput+0x62/0x70
<4> [<ffffffffa06798d0>] rfs_d_iput+0x160/0x1c0 [redirfs]
<4> [<ffffffff815489be>] ? mutex_lock+0x1e/0x50
<4> [<ffffffff811b3bbc>] dentry_iput+0x7c/0x100
<4> [<ffffffff811b3d31>] d_kill+0x31/0x60
<4> [<ffffffff811b597d>] dput+0xcd/0x160
<4> [<ffffffff811abab8>] sys_renameat+0x348/0x3a0
<4> [<ffffffff810ee687>] ? audit_syscall_entry+0x1d7/0x200
<4> [<ffffffff811abb2b>] sys_rename+0x1b/0x20
<4> [<ffffffff8100b0d2>] system_call_fastpath+0x16/0x1b
<4>Code: d8 e0 48 85 c0 49 89 c4 0f 84 89 02 00 00 f6 00 01 74 5e 4d 89 26 31 c0 eb 29 0f 1f 80 00 00 00 00 48 83 f8 07 0f 84 32 ff ff ff <48> 8b b3 90 02 00 00 48 63 8e a0 00 00 00 48 39 c8 73 23 b8 fb
<1>RIP  [<ffffffffa04477da>] __ext4_get_inode_loc+0x11a/0x3b0 [ext4]
<4> RSP <ffff880862c77ac8>
<4>CR2: 000060e7a3807c90