GFS filesystem corruption in function "function = gfs_setbit" with Red Hat Cluster Suite

Solution Verified - Updated -

Issue

  • In the middle of processing a mount point was lost.  Attempts to remount came up with an IO error.
  • The following errors are found in /var/log/messages:
    kernel: GFS: fsid=cluster:gfs1.0: fatal: filesystem consistency error
    kernel: GFS: fsid=cluster:gfs1.0:   RG = 3958400
    kernel: GFS: fsid=cluster:gfs1.0:   function = gfs_setbit
    kernel: GFS: fsid=cluster:gfs1.0:   file = /builddir/build/BUILD/gfs-kmod-0.1.34/_kmod_build_/src/gfs/bits.c, line = 81
    kernel: GFS: fsid=cluster:gfs1.0:   time = 1289858275
    kernel: GFS: fsid=cluster:gfs1.0: about to withdraw from the cluster
    kernel: GFS: fsid=cluster:gfs1.0: telling LM to withdraw
    kernel: GFS: fsid=cluster:gfs1.0: withdrawn
    kernel: 
    kernel: Call Trace:
    kernel:  [<ffffffff886ad174>] :gfs:gfs_lm_withdraw+0xd4/0x101
    kernel:  [<ffffffff8001549c>] sync_buffer+0x0/0x3f
    kernel:  [<ffffffff80063ab0>] out_of_line_wait_on_bit+0x6c/0x78
    kernel:  [<ffffffff8002e1b0>] __wake_up+0x38/0x4f
    kernel:  [<ffffffff800db979>] alternate_node_alloc+0x70/0x8c
    kernel:  [<ffffffff8869adec>] :gfs:gfs_dpin+0x121/0x211
    kernel:  [<ffffffff886c4fa9>] :gfs:gfs_consist_rgrpd_i+0x3c/0x41
    kernel:  [<ffffffff886c0690>] :gfs:blkfree_internal+0x125/0x147
    kernel:  [<ffffffff886c06cc>] :gfs:gfs_difree_uninit+0x1a/0xc9
    kernel:  [<ffffffff886c0791>] :gfs:gfs_difree+0x16/0x45
    kernel:  [<ffffffff886a7ac8>] :gfs:gfs_inode_dealloc+0x4f8/0x53c
    kernel:  [<ffffffff800a07c0>] keventd_create_kthread+0x0/0xc4
    kernel:  [<ffffffff886c44af>] :gfs:gfs_unlinked_dealloc+0x31/0xb3
    kernel:  [<ffffffff886991d4>] :gfs:gfs_inoded+0x0/0x44
    kernel:  [<ffffffff886991e2>] :gfs:gfs_inoded+0xe/0x44
    kernel:  [<ffffffff8003287b>] kthread+0xfe/0x132
    kernel:  [<ffffffff8005dfb1>] child_rip+0xa/0x11
    kernel:  [<ffffffff800a07c0>] keventd_create_kthread+0x0/0xc4
    kernel:  [<ffffffff8003277d>] kthread+0x0/0x132
    kernel:  [<ffffffff8005dfa7>] child_rip+0x0/0x11
    

Environment

  • Red Hat Enterprise Linux
  • Red Hat Cluster Suite
  • Red Hat GFS filesystem

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In