Why did my GFS2 filesystem withdraw with: "function = gfs2_rgrp_go_lock, file = fs/gfs2/rgrp.c, line = 1033"

Solution In Progress - Updated -

Issue

  • A GFS2 fs withdraw is see with the following messages on RHEL 6:
Feb  4 20:56:42 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=6: Trying to acquire journal lock...
Feb  4 20:56:42 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=6: Busy, retrying...
Feb  4 20:56:46 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=6: Busy, retrying...
Feb  4 20:56:47 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=6: Busy, retrying...
Feb  4 20:56:48 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=6: Busy, gave up.
Feb  4 20:57:17 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=4: Trying to acquire journal lock...
Feb  4 20:57:17 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=4: Busy, retrying...
Feb  4 20:57:20 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=4: Busy, retrying...
Feb  4 20:57:21 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=4: Looking at journal...
Feb  4 20:57:21 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: jid=4: Done
Feb  4 20:57:27 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: fatal: invalid metadata block
Feb  4 20:57:27 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3:   bh = 474593225 (type: exp=3, found=5)
Feb  4 20:57:27 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3:   function = gfs2_rgrp_go_lock, file = fs/gfs2/rgrp.c, line = 1033
Feb  4 20:57:27 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: about to withdraw this file system
Feb  4 20:57:28 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: telling LM to unmount
Feb  4 20:57:28 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: withdrawn
Feb  4 20:57:28 node1 kernel: Pid: 5903, comm: glock_workqueue Not tainted 2.6.32-642.3.1.el6.x86_64 #1
Feb  4 20:57:28 node1 kernel: Call Trace:
Feb  4 20:57:28 node1 kernel: [] ? gfs2_lm_withdraw+0x128/0x160 [gfs2]
Feb  4 20:57:28 node1 kernel: [] ? out_of_line_wait_on_bit+0x78/0x90
Feb  4 20:57:28 node1 kernel: [] ? gfs2_metatype_check_ii+0x50/0x60 [gfs2]
Feb  4 20:57:28 node1 kernel: [] ? gfs2_rgrp_go_lock+0x220/0x260 [gfs2]
Feb  4 20:57:28 node1 kernel: [] ? do_promote+0x1cb/0x340 [gfs2]
Feb  4 20:57:28 node1 kernel: [] ? finish_xmote+0x180/0x410 [gfs2]
Feb  4 20:57:28 node1 kernel: [] ? glock_work_func+0x133/0x1d0 [gfs2]
Feb  4 20:57:28 node1 kernel: [] ? glock_work_func+0x0/0x1d0 [gfs2]
Feb  4 20:57:28 node1 kernel: [] ? worker_thread+0x170/0x2a0
Feb  4 20:57:28 node1 kernel: [] ? autoremove_wake_function+0x0/0x40
Feb  4 20:57:28 node1 kernel: [] ? worker_thread+0x0/0x2a0
Feb  4 20:57:28 node1 kernel: [] ? kthread+0x9e/0xc0
Feb  4 20:57:28 node1 kernel: [] ? child_rip+0xa/0x20
Feb  4 20:57:28 node1 kernel: [] ? kthread+0x0/0xc0
Feb  4 20:57:28 node1 kernel: [] ? child_rip+0x0/0x20
Feb  4 20:57:28 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:57:29 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:57:52 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:58:16 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:58:47 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:58:49 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:00 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:07 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:07 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:07 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:07 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:08 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:28 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:32 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:37 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:46 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 20:59:59 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5
Feb  4 21:00:05 node1 kernel: GFS2: fsid=gfs2fs:stripedlv.3: dirty_inode: glock -5

Environment

  • Red Hat Enterprise Linux Server 6, 7 (with the High Availability and Resilient Storage Add Ons)
  • A Global Filesystem 2(GFS2)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content