Why did GFS2 filesystem withdraw with "fatal: invalid metadata block" and "function = get_leaf, file = fs/gfs2/dir.c, line = 701" when trying to mount on RHEL 5.4?

Solution Verified - Updated -

Issue

  • Getting "input/output IO error" messages, when trying to cd into the mountpoint or to any others directories underneath it.
  • The df command on the mountpoint was just displaying ???? marks.
  • Unable to umount GFS2 filesystem.
  • The following error messages were found in /var/log/messages:
Feb 21 21:32:19 <hostname> kernel: GFS2: fsid=va2xpcpb01_02:query.0: fatal: invalid metadata block
Feb 21 21:32:19 <hostname> kernel: GFS2: fsid=va2xpcpb01_02:query.0:   bh = 0 (magic number)
Feb 21 21:32:19 <hostname> kernel: GFS2: fsid=va2xpcpb01_02:query.0:   function = get_leaf, file = fs/gfs2/dir.c, line = 701
Feb 21 21:32:19 <hostname> kernel: GFS2: fsid=va2xpcpb01_02:query.0: about to withdraw this file system
Feb 21 21:32:19 <hostname> kernel: GFS2: fsid=va2xpcpb01_02:query.0: telling LM to withdraw
Feb 21 21:32:19 <hostname> kernel: GFS2: fsid=va2xpcpb01_02:query.0: gfs2_delete_inode: -5
Feb 21 21:32:20 <hostname> kernel: GFS2: fsid=va2xpcpb01_02:query.0: withdrawn
Feb 21 21:32:20 <hostname> kernel:
Feb 21 21:32:20 <hostname> kernel: Call Trace:
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff88587526>] :gfs2:gfs2_lm_withdraw+0xc1/0xd0
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff80063ae7>] __wait_on_bit+0x60/0x6e
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff80015008>] sync_buffer+0x0/0x3f
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff80063b61>] out_of_line_wait_on_bit+0x6c/0x78
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff8009dbd6>] wake_bit_function+0x0/0x23
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff8001a370>] submit_bh+0x10a/0x111
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff8859a68f>] :gfs2:gfs2_meta_check_ii+0x2c/0x38
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff8857d51c>] :gfs2:get_leaf+0x6b/0xa8
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff8857ed52>] :gfs2:gfs2_dir_read+0x1c8/0x535
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff80025256>] filldir+0x0/0xb7
Feb 21 21:32:20 <hostname> kernel:  [<ffffffff80025256>] filldir+0x0/0xb7
Feb 21 21:32:21 <hostname> kernel:  [<ffffffff8858eb0b>] :gfs2:gfs2_readdir+0x6b/0x8f
Feb 21 21:32:21 <hostname> kernel:  [<ffffffff8858eae0>] :gfs2:gfs2_readdir+0x40/0x8f
Feb 21 21:32:21 <hostname> kernel:  [<ffffffff80025256>] filldir+0x0/0xb7
Feb 21 21:32:21 <hostname> kernel:  [<ffffffff80034c9a>] vfs_readdir+0x77/0xa9
Feb 21 21:32:21 <hostname> kernel:  [<ffffffff80038542>] sys_getdents+0x75/0xbd
Feb 21 21:32:21 <hostname> kernel:  [<ffffffff8005dde9>] error_exit+0x0/0x84
Feb 21 21:32:21 <hostname> kernel:  [<ffffffff8005d116>] system_call+0x7e/0x83

Environment

  • Red Hat Enterprise Linux 5.4
  • Red Hat Cluster Suite 5
  • GFS2 filesystem

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content