A gfs2 filesystem had a withdraw: function = gfs2_meta_indirect_buffer, file = fs/gfs2/meta_io.c, line = 428

Solution In Progress - Updated -

Issue

A gfs2 filesystem had a withdraw: function = gfs2_meta_indirect_buffer, file = fs/gfs2/meta_io.c, line = 428

Jan 25 02:42:53 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: recover generation 9 done
Jan 25 02:45:08 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: recover generation 10 done
Jan 25 02:45:13 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: recover generation 11 done
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: fatal: invalid metadata block
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0:   bh = 120453122 (magic number)
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0:   function = gfs2_meta_indirect_buffer, file = fs/gfs2/meta_io.c, line = 428
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: about to withdraw this file system
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: telling LM to unmount
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: withdrawn
Jan 25 02:45:21 node42 kernel: CPU: 3 PID: 11045 Comm: kworker/3:1H Kdump: loaded Not tainted 3.10.0-862.9.1.el7.x86_64 #1
Jan 25 02:45:21 node42 kernel: Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Jan 25 02:45:21 node42 kernel: Workqueue: glock_workqueue glock_work_func [gfs2]
Jan 25 02:45:21 node42 kernel: Call Trace:
Jan 25 02:45:21 node42 kernel: [<ffffffff9bd0e84e>] dump_stack+0x19/0x1b
Jan 25 02:45:21 node42 kernel: [<ffffffffc0720df6>] gfs2_lm_withdraw+0x146/0x180 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc07210e5>] gfs2_meta_check_ii+0x45/0x50 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc0707df9>] gfs2_meta_indirect_buffer+0xe9/0x150 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6c8204>] ? __wake_up+0x44/0x50
Jan 25 02:45:21 node42 kernel: [<ffffffffc0703c04>] gfs2_inode_refresh+0x34/0x90 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc0703cd8>] inode_go_lock+0x78/0xf0 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc06ffb9a>] do_promote+0x1ba/0x320 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc0701878>] finish_xmote+0x178/0x4c0 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc07021a2>] glock_work_func+0xc2/0x120 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6b35ef>] process_one_work+0x17f/0x440
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6b4686>] worker_thread+0x126/0x3c0
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6b4560>] ? manage_workers.isra.24+0x2a0/0x2a0
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6bb621>] kthread+0xd1/0xe0
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6bb550>] ? insert_kthread_work+0x40/0x40
Jan 25 02:45:21 node42 kernel: [<ffffffff9bd205f7>] ret_from_fork_nospec_begin+0x21/0x21
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6bb550>] ? insert_kthread_work+0x40/0x40

A gfs2 withdraw occurred:

Mar 14 05:32:41 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:32:41 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:32:53 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:32:56 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:33:01 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:33:01 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0: fatal: invalid metadata block
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0:   bh = 474771 (magic number)
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0:   function = gfs2_meta_indirect_buffer, file = fs/gfs2/meta_io.c, line = 428
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0: about to withdraw this file system
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0: telling LM to unmount
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0: withdrawn
Mar 14 05:33:36 node42 kernel: CPU: 0 PID: 573 Comm: kworker/0:1H Kdump: loaded Not tainted 3.10.0-862.el7.x86_64 #1
Mar 14 05:33:36 node42 kernel: Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Mar 14 05:33:36 node42 kernel: Workqueue: glock_workqueue glock_work_func [gfs2]
Mar 14 05:33:36 node42 kernel: Call Trace:
Mar 14 05:33:36 node42 kernel: [<ffffffffb8d0d768>] dump_stack+0x19/0x1b
Mar 14 05:33:36 node42 kernel: [<ffffffffc072cdf6>] gfs2_lm_withdraw+0x146/0x180 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc072d0e5>] gfs2_meta_check_ii+0x45/0x50 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc0713df9>] gfs2_meta_indirect_buffer+0xe9/0x150 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffb86c7a14>] ? __wake_up+0x44/0x50
Mar 14 05:33:36 node42 kernel: [<ffffffffc070fc04>] gfs2_inode_refresh+0x34/0x90 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc070fcd8>] inode_go_lock+0x78/0xf0 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc070bb9a>] do_promote+0x1ba/0x320 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc070d878>] finish_xmote+0x178/0x4c0 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc070e1a2>] glock_work_func+0xc2/0x120 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffb86b2dff>] process_one_work+0x17f/0x440
Mar 14 05:33:36 node42 kernel: [<ffffffffb86b3ac6>] worker_thread+0x126/0x3c0
Mar 14 05:33:36 node42 kernel: [<ffffffffb86b39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
Mar 14 05:33:36 node42 kernel: [<ffffffffb86bae31>] kthread+0xd1/0xe0
Mar 14 05:33:36 node42 kernel: [<ffffffffb86bad60>] ? insert_kthread_work+0x40/0x40
Mar 14 05:33:36 node42 kernel: [<ffffffffb8d1f637>] ret_from_fork_nospec_begin+0x21/0x21
Mar 14 05:33:36 node42 kernel: [<ffffffffb86bad60>] ? insert_kthread_work+0x40/0x40

Environment

  • Red Hat Enterprise Linux Server 7 (with the High Availability Add On and Resilient Storage Add Ons)
  • A Global Filesystem 2(gfs2)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content