Gluster node panicked in xfs_dir2_data_use_free() due to corrupt on-disk data

Solution In Progress - Updated -

Issue

  • System panicked with this message:
BUG: unable to handle kernel paging request at ffffc90038490e00
IP: [<ffffffffa02badd9>] xfs_dir2_data_use_free+0xf9/0x2b0 [xfs]
PGD 107fc15067 PUD 87febf067 PMD f98071067 PTE 0
Oops: 0002 [#1] SMP 
last sysfs file: /sys/kernel/mm/redhat_transparent_hugepage/enabled
CPU 3 
Modules linked in: iptable_nat nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 bridge ip6_tables iptable_filter ip_tables ebtable_nat ebtables fuse softdog mpt2sas scsi_transport_sas raid_class mptctl mptbase sunrpc cpufreq_ondemand acpi_cpufreq freq_table mperf bonding 8021q garp stp llc ipv6 xfs exportfs vfat fat vhost_net macvtap macvlan tun kvm_intel kvm microcode i2c_i801 i2c_core iTCO_wdt iTCO_vendor_support igb shpchp ioatdma ixgbe dca ptp pps_core mdio ses enclosure sg ext4 jbd2 mbcache sd_mod crc_t10dif wmi megaraid_sas dm_multipath dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_wait_scan]

Pid: 4067, comm: glusterfsd Not tainted 2.6.32-358.32.3.el6.x86_64 #1 IBM  -[7158H2J]-/00FL490
RIP: 0010:[<ffffffffa02badd9>]  [<ffffffffa02badd9>] xfs_dir2_data_use_free+0xf9/0x2b0 [xfs]
RSP: 0018:ffff8808433a9a88  EFLAGS: 00010203
RAX: ffffc9003848a004 RBX: ffffc9003848a570 RCX: 0000000000000570
RDX: 0000000038487005 RSI: 0000000000000001 RDI: ffffc9003848a000
RBP: ffff8808433a9ae8 R08: 0000000000006892 R09: ffff8808433a9b70
R10: 0000000000000030 R11: ffffc9003848a540 R12: ffff8805d7ddcf78
R13: 0000000000000570 R14: 0000000000000030 R15: ffffc9003848a000
FS:  00007f2164504700(0000) GS:ffff880028260000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffc90038490e00 CR3: 0000001072517000 CR4: 00000000000407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process glusterfsd (pid: 4067, threadinfo ffff8808433a8000, task ffff8808615f6040)
Stack:
 ffff8805d7ddcb70 ffffc9003790e0a0 ffff8808433a9ca8 ffffc9003790e000
<d> ffff88000b5fd928 ffff8808433a9b70 ffff8808433a9ae8 ffffc9003790e0a0
<d> ffff8808433a9ca8 ffffc9003790e000 ffff88087181d000 ffffc9003790fffa
Call Trace:
 [<ffffffffa02bca56>] xfs_dir2_leaf_addname+0x316/0x900 [xfs]
 [<ffffffffa02ba983>] xfs_dir2_block_addname+0x853/0x9a0 [xfs]
 [<ffffffffa02b8d3a>] xfs_dir_createname+0x13a/0x1b0 [xfs]
 [<ffffffffa02e3d20>] xfs_link+0x1f0/0x300 [xfs]
 [<ffffffff811a2100>] ? mntput_no_expire+0x30/0x110
 [<ffffffff8119af57>] ? __d_lookup+0xa7/0x150
 [<ffffffffa02f1c70>] xfs_vn_link+0x40/0x70 [xfs]
 [<ffffffff8118f88c>] vfs_link+0x11c/0x190
 [<ffffffff8118eb9a>] ? lookup_hash+0x3a/0x50
 [<ffffffff81192b64>] sys_linkat+0x114/0x150
 [<ffffffff8119254f>] ? sys_mkdirat+0xef/0x130
 [<ffffffff81186e6e>] ? vfs_lstat+0x1e/0x20
 [<ffffffff81186e94>] ? sys_newlstat+0x24/0x50
 [<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
Code: f0 48 8d 0c 0b 66 41 c1 c0 08 49 8d 1c 0f 89 da 66 44 89 43 02 66 c7 03 ff ff 66 44 29 fa 66 41 c1 c0 08 66 c1 c2 08 45 0f b7 c0 <66> 42 89 54 03 fe 48 8b 7d c0 48 89 da 4c 89 e6 48 89 45 b8 e8 
RIP  [<ffffffffa02badd9>] xfs_dir2_data_use_free+0xf9/0x2b0 [xfs]
 RSP <ffff8808433a9a88>
CR2: ffffc90038490e00

Environment

  • Red Hat Enterprise Linux 6.4
  • XFS
  • Glusterfs

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.