A gfs2 filesystem had a withdraw: function = gfs2_meta_indirect_buffer, file = fs/gfs2/meta_io.c, line = 428

Solution In Progress - Updated -

Issue

A gfs2 filesystem had a withdraw: function = gfs2_meta_indirect_buffer, file = fs/gfs2/meta_io.c, line = 428

Jan 25 02:42:53 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: recover generation 9 done
Jan 25 02:45:08 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: recover generation 10 done
Jan 25 02:45:13 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: recover generation 11 done
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: fatal: invalid metadata block
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0:   bh = 120453122 (magic number)
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0:   function = gfs2_meta_indirect_buffer, file = fs/gfs2/meta_io.c, line = 428
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: about to withdraw this file system
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: telling LM to unmount
Jan 25 02:45:21 node42 kernel: GFS2: fsid=rhel7cluster:saswork.0: withdrawn
Jan 25 02:45:21 node42 kernel: CPU: 3 PID: 11045 Comm: kworker/3:1H Kdump: loaded Not tainted 3.10.0-862.9.1.el7.x86_64 #1
Jan 25 02:45:21 node42 kernel: Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Jan 25 02:45:21 node42 kernel: Workqueue: glock_workqueue glock_work_func [gfs2]
Jan 25 02:45:21 node42 kernel: Call Trace:
Jan 25 02:45:21 node42 kernel: [<ffffffff9bd0e84e>] dump_stack+0x19/0x1b
Jan 25 02:45:21 node42 kernel: [<ffffffffc0720df6>] gfs2_lm_withdraw+0x146/0x180 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc07210e5>] gfs2_meta_check_ii+0x45/0x50 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc0707df9>] gfs2_meta_indirect_buffer+0xe9/0x150 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6c8204>] ? __wake_up+0x44/0x50
Jan 25 02:45:21 node42 kernel: [<ffffffffc0703c04>] gfs2_inode_refresh+0x34/0x90 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc0703cd8>] inode_go_lock+0x78/0xf0 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc06ffb9a>] do_promote+0x1ba/0x320 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc0701878>] finish_xmote+0x178/0x4c0 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffffc07021a2>] glock_work_func+0xc2/0x120 [gfs2]
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6b35ef>] process_one_work+0x17f/0x440
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6b4686>] worker_thread+0x126/0x3c0
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6b4560>] ? manage_workers.isra.24+0x2a0/0x2a0
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6bb621>] kthread+0xd1/0xe0
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6bb550>] ? insert_kthread_work+0x40/0x40
Jan 25 02:45:21 node42 kernel: [<ffffffff9bd205f7>] ret_from_fork_nospec_begin+0x21/0x21
Jan 25 02:45:21 node42 kernel: [<ffffffff9b6bb550>] ? insert_kthread_work+0x40/0x40

A gfs2 withdraw occurred:

Mar 14 05:32:41 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:32:41 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:32:53 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:32:56 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:33:01 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:33:01 node42 kernel: GFS2: fsid=supercluster:lv2.0: Number of entries corrupt in dir 899027, ip->i_entries (18) != g.offset (19)
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0: fatal: invalid metadata block
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0:   bh = 474771 (magic number)
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0:   function = gfs2_meta_indirect_buffer, file = fs/gfs2/meta_io.c, line = 428
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0: about to withdraw this file system
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0: telling LM to unmount
Mar 14 05:33:36 node42 kernel: GFS2: fsid=supercluster:lv1.0: withdrawn
Mar 14 05:33:36 node42 kernel: CPU: 0 PID: 573 Comm: kworker/0:1H Kdump: loaded Not tainted 3.10.0-862.el7.x86_64 #1
Mar 14 05:33:36 node42 kernel: Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Mar 14 05:33:36 node42 kernel: Workqueue: glock_workqueue glock_work_func [gfs2]
Mar 14 05:33:36 node42 kernel: Call Trace:
Mar 14 05:33:36 node42 kernel: [<ffffffffb8d0d768>] dump_stack+0x19/0x1b
Mar 14 05:33:36 node42 kernel: [<ffffffffc072cdf6>] gfs2_lm_withdraw+0x146/0x180 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc072d0e5>] gfs2_meta_check_ii+0x45/0x50 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc0713df9>] gfs2_meta_indirect_buffer+0xe9/0x150 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffb86c7a14>] ? __wake_up+0x44/0x50
Mar 14 05:33:36 node42 kernel: [<ffffffffc070fc04>] gfs2_inode_refresh+0x34/0x90 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc070fcd8>] inode_go_lock+0x78/0xf0 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc070bb9a>] do_promote+0x1ba/0x320 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc070d878>] finish_xmote+0x178/0x4c0 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffc070e1a2>] glock_work_func+0xc2/0x120 [gfs2]
Mar 14 05:33:36 node42 kernel: [<ffffffffb86b2dff>] process_one_work+0x17f/0x440
Mar 14 05:33:36 node42 kernel: [<ffffffffb86b3ac6>] worker_thread+0x126/0x3c0
Mar 14 05:33:36 node42 kernel: [<ffffffffb86b39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
Mar 14 05:33:36 node42 kernel: [<ffffffffb86bae31>] kthread+0xd1/0xe0
Mar 14 05:33:36 node42 kernel: [<ffffffffb86bad60>] ? insert_kthread_work+0x40/0x40
Mar 14 05:33:36 node42 kernel: [<ffffffffb8d1f637>] ret_from_fork_nospec_begin+0x21/0x21
Mar 14 05:33:36 node42 kernel: [<ffffffffb86bad60>] ? insert_kthread_work+0x40/0x40

Environment

  • Red Hat Enterprise Linux Server 7 (with the High Availability Add On and Resilient Storage Add Ons)
  • A Global Filesystem 2(gfs2)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In