GFS filesystem corruption in function "function = gfs_setbit" with Red Hat Cluster Suite

Solution Verified - Updated -

Issue

  • In the middle of processing a mount point was lost.  Attempts to remount came up with an IO error.
  • The following errors are found in /var/log/messages:
    kernel: GFS: fsid=cluster:gfs1.0: fatal: filesystem consistency error
    kernel: GFS: fsid=cluster:gfs1.0:   RG = 3958400
    kernel: GFS: fsid=cluster:gfs1.0:   function = gfs_setbit
    kernel: GFS: fsid=cluster:gfs1.0:   file = /builddir/build/BUILD/gfs-kmod-0.1.34/_kmod_build_/src/gfs/bits.c, line = 81
    kernel: GFS: fsid=cluster:gfs1.0:   time = 1289858275
    kernel: GFS: fsid=cluster:gfs1.0: about to withdraw from the cluster
    kernel: GFS: fsid=cluster:gfs1.0: telling LM to withdraw
    kernel: GFS: fsid=cluster:gfs1.0: withdrawn
    kernel: 
    kernel: Call Trace:
    kernel:  [<ffffffff886ad174>] :gfs:gfs_lm_withdraw+0xd4/0x101
    kernel:  [<ffffffff8001549c>] sync_buffer+0x0/0x3f
    kernel:  [<ffffffff80063ab0>] out_of_line_wait_on_bit+0x6c/0x78
    kernel:  [<ffffffff8002e1b0>] __wake_up+0x38/0x4f
    kernel:  [<ffffffff800db979>] alternate_node_alloc+0x70/0x8c
    kernel:  [<ffffffff8869adec>] :gfs:gfs_dpin+0x121/0x211
    kernel:  [<ffffffff886c4fa9>] :gfs:gfs_consist_rgrpd_i+0x3c/0x41
    kernel:  [<ffffffff886c0690>] :gfs:blkfree_internal+0x125/0x147
    kernel:  [<ffffffff886c06cc>] :gfs:gfs_difree_uninit+0x1a/0xc9
    kernel:  [<ffffffff886c0791>] :gfs:gfs_difree+0x16/0x45
    kernel:  [<ffffffff886a7ac8>] :gfs:gfs_inode_dealloc+0x4f8/0x53c
    kernel:  [<ffffffff800a07c0>] keventd_create_kthread+0x0/0xc4
    kernel:  [<ffffffff886c44af>] :gfs:gfs_unlinked_dealloc+0x31/0xb3
    kernel:  [<ffffffff886991d4>] :gfs:gfs_inoded+0x0/0x44
    kernel:  [<ffffffff886991e2>] :gfs:gfs_inoded+0xe/0x44
    kernel:  [<ffffffff8003287b>] kthread+0xfe/0x132
    kernel:  [<ffffffff8005dfb1>] child_rip+0xa/0x11
    kernel:  [<ffffffff800a07c0>] keventd_create_kthread+0x0/0xc4
    kernel:  [<ffffffff8003277d>] kthread+0x0/0x132
    kernel:  [<ffffffff8005dfa7>] child_rip+0x0/0x11
    

Environment

  • Red Hat Enterprise Linux
  • Red Hat Cluster Suite
  • Red Hat GFS filesystem

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content