GFS filesystem withdraws due to "invalid metadata block" reporting "(type: exp=4, found=6)" in RHEL 5 Update 6
Issue
- GFS withdraws with
type exp
andfound
values not matching - GFS filesystem withdraws with the following error:
kernel: GFS: fsid=mycluster:fs1: fatal: invalid metadata block
kernel: GFS: fsid=mycluster:fs1: bh = 25 (type: exp=4, found=6)
kernel: GFS: fsid=mycluster:fs1: function = gfs_get_meta_buffer
kernel: GFS: fsid=mycluster:fs1: file = /builddir/build/BUILD/gfs-kmod-0.1.34/_kmod_build_/src/gfs/dio.c, line = 1112
kernel: GFS: fsid=mycluster:fs1: time = 1389651234
kernel: GFS: fsid=mycluster:fs1: about to withdraw from the cluster
kernel: GFS: fsid=mycluster:fs1: telling LM to withdraw
kernel: GFS: fsid=mycluster:fs1: withdrawn
kernel:
kernel: Call Trace:
kernel: [<ffffffff889310a0>] :gfs:gfs_lm_withdraw+0xd4/0x101
kernel: [<ffffffff80063a16>] __wait_on_bit+0x60/0x6e
kernel: [<ffffffff8001559a>] sync_buffer+0x0/0x3f
kernel: [<ffffffff80063a90>] out_of_line_wait_on_bit+0x6c/0x78
kernel: [<ffffffff800a2992>] wake_bit_function+0x0/0x23
kernel: [<ffffffff889492a1>] :gfs:gfs_metatype_check_ii+0x39/0x45
kernel: [<ffffffff8891e481>] :gfs:gfs_get_meta_buffer+0x1f3/0x242
kernel: [<ffffffff8892b20b>] :gfs:gfs_copyin_dinode+0x1d/0x12f
kernel: [<ffffffff88929c58>] :gfs:inode_go_lock+0x27/0x3f
kernel: [<ffffffff88927902>] :gfs:glock_wait_internal+0x23f/0x2d8
kernel: [<ffffffff88927d45>] :gfs:gfs_glock_nq+0x3aa/0x3ea
kernel: [<ffffffff800a274c>] keventd_create_kthread+0x0/0xc4
kernel: [<ffffffff88927d9b>] :gfs:gfs_glock_nq_init+0x16/0x2a
kernel: [<ffffffff889465db>] :gfs:gfs_statfs_sync+0x31/0x175
kernel: [<ffffffff800a274c>] keventd_create_kthread+0x0/0xc4
kernel: [<ffffffff8891d4a6>] :gfs:gfs_quotad+0x73/0x16d
kernel: [<ffffffff8891d433>] :gfs:gfs_quotad+0x0/0x16d
kernel: [<ffffffff80032b04>] kthread+0xfe/0x132
kernel: [<ffffffff8005dfb1>] child_rip+0xa/0x11
kernel: [<ffffffff800a274c>] keventd_create_kthread+0x0/0xc4
kernel: [<ffffffff80032a06>] kthread+0x0/0x132
kernel: [<ffffffff8005dfa7>] child_rip+0x0/0x11
Environment
- Red Hat Enterprise Linux (RHEL) 5 Update 6 with the Resilient Storage Add On
- GFS
- One or more withdrawls indicating
invalid metadata block
andbh = X (type: exp=Y, found=Z)
, where Y and Z do not match
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.