A kernel panic occurred accessing a gfs2 filesystem: fs/gfs2/glock.c:863!

Solution In Progress - Updated -

Issue

  • A kernel panic occurred accessing a gfs2 filesystem: fs/gfs2/glock.c:863!
[ 3992.570333] gfs2: fsid=RHCS:gfs2_0.1: jid=0: Done
[ 3992.570356] gfs2: fsid=RHCS:gfs2_0.1: recover generation 3 done
[ 3992.579276] qla2xxx [0000:03:00.1]-301f:12: Dropped frame(s) detected (0xf000 of 0x10000 bytes).
[ 3992.579285] qla2xxx [0000:03:00.1]-3022:12: FCP command status: 0x15-0x0 (0x70000) nexus=12:4:300 portid=0b0800 oxid=0x6c9 cdb=280000002d8000008000 len=0x10000 rsp_info=0x0 resid=0x0 fw_resid=0xf000 sp=0000000097e07a50 cp=000000008eea7402.
[ 3992.579307] sd 12:0:4:300: [sdw] tag#1421 FAILED Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK cmd_age=0s
[ 3992.579313] sd 12:0:4:300: [sdw] tag#1421 CDB: Read(10) 28 00 00 00 2d 80 00 00 80 00
[ 3992.579316] I/O error, dev sdw, sector 11648 op 0x0:(READ) flags 0x4700 phys_seg 1 prio class 0
[ 3992.579339] qla2xxx [0000:03:00.1]-301f:12: Dropped frame(s) detected (0x7800 of 0x10000 bytes).
[ 3992.579344] qla2xxx [0000:03:00.1]-3022:12: FCP command status: 0x15-0x0 (0x70000) nexus=12:4:300 portid=0b0800 oxid=0x6d4 cdb=28000000338000008000 len=0x10000 rsp_info=0x0 resid=0x0 fw_resid=0x7800 sp=00000000c13229b1 cp=000000004b9322f6.
[ 3992.579355] sd 12:0:4:300: [sdw] tag#1432 FAILED Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK cmd_age=0s
[ 3992.579359] sd 12:0:4:300: [sdw] tag#1432 CDB: Read(10) 28 00 00 00 33 80 00 00 80 00
[ 3992.579361] I/O error, dev sdw, sector 13184 op 0x0:(READ) flags 0x4700 phys_seg 1 prio class 0
[ 3992.634952] gfs2: fsid=RHCS:gfs2_1.1: jid=0: Journal head lookup took 333ms
[ 3992.634954] gfs2: fsid=RHCS:gfs2_1.1: jid=0: Acquiring the transaction lock...
[ 3992.634956] gfs2: fsid=RHCS:gfs2_1.1: jid=0: Replaying journal...0x25ed to 0x25f5
[ 3992.637708] gfs2: fsid=RHCS:gfs2_1.1: jid=0: Replayed 2 of 5 blocks
[ 3992.637711] gfs2: fsid=RHCS:gfs2_1.1: jid=0: Found 3 revoke tags
[ 3992.638022] gfs2: fsid=RHCS:gfs2_1.1: jid=0: Updated master statfs Total:5240200, Free:5196911, Dinodes:17 after change [+0,-435,+0]
[ 3992.648944] gfs2: fsid=RHCS:gfs2_1.1: jid=0: Journal replayed in 348ms [jlck:1ms, jhead:333ms, tlck:0ms, replay:13ms]
[ 3992.648981] gfs2: fsid=RHCS:gfs2_1.1: recover jid 0 result success
[ 3992.648989] gfs2: fsid=RHCS:gfs2_1.1: jid=0: Done
[ 3992.649003] gfs2: fsid=RHCS:gfs2_1.1: recover generation 3 done
[ 3992.649261] gfs2: fsid=RHCS:gfs2_1.1: lm_lock ret -22
[ 3992.649288] gfs2: fsid=RHCS:gfs2_1.1: G:  s:DF n:2/826e f:lIqob t:EX d:EX/0 a:0 v:0 r:4 m:60 p:2
[ 3992.649293] gfs2: fsid=RHCS:gfs2_1.1:  H: s:EX f:W e:0 p:46097 [fio] __mark_inode_dirty+0x126/0x350
[ 3992.649304] gfs2: fsid=RHCS:gfs2_1.1:  I: n:1/33390 t:8 f:0x00 d:0x00000000 s:8517476352 p:0
[ 3992.649325] ------------[ cut here ]------------
[ 3992.649326] kernel BUG at fs/gfs2/glock.c:863!
[ 3992.649334] invalid opcode: 0000 [#1] PREEMPT SMP PTI
[ 3992.649338] CPU: 4 PID: 46097 Comm: fio Kdump: loaded Tainted: P           OE    --------- ---  5.14.0-70.13.1.el9_0.x86_64 #1
[ 3992.649341] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.13.0 05/14/2021
[ 3992.649343] RIP: 0010:do_xmote.cold+0x65/0x67 [gfs2]
[ 3992.649367] Code: 6c c1 e8 36 b1 78 c4 ba 01 00 00 00 48 89 ee 31 ff e8 4f b8 fd ff e9 90 d8 fd ff ba 01 00 00 00 48 89 ee 31 ff e8 3b b8 fd ff <0f> 0b 49 8b 44 24 10 b9 01 00 00 00 0f b6 d2 48 c7 c7 e8 01 6c c1
[ 3992.649369] RSP: 0018:ffffaf5d0dcdfb38 EFLAGS: 00010296
[ 3992.649372] RAX: 0000000000000000 RBX: ffff947df74b3000 RCX: 0000000000000027
[ 3992.649375] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff947d9f897cc0
[ 3992.649376] RBP: ffff9477251ea288 R08: 0000000000000000 R09: ffffaf5d0dcdf700
[ 3992.649378] R10: ffffaf5d0dcdf6f8 R11: ffffffff871e8228 R12: 0000000000000001
[ 3992.649380] R13: ffffffffc16a9520 R14: 0000000000000000 R15: ffff9477251ea2a8
[ 3992.649381] FS:  00007efcb184c000(0000) GS:ffff947d9f880000(0000) knlGS:0000000000000000
[ 3992.649384] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 3992.649385] CR2: 00007f4efabc01b8 CR3: 000000021311c002 CR4: 00000000003706e0
[ 3992.649387] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 3992.649389] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 3992.649390] Call Trace:
[ 3992.649396]  gfs2_glock_nq+0x58/0xc0 [gfs2]
[ 3992.649410]  gfs2_dirty_inode+0xd4/0x230 [gfs2]
[ 3992.649425]  ? __mark_inode_dirty+0x126/0x350
[ 3992.649429]  __mark_inode_dirty+0x126/0x350
[ 3992.649433]  generic_update_time+0x6c/0xc0
[ 3992.649438]  file_update_time+0xea/0x140
[ 3992.649441]  gfs2_file_write_iter+0xf4/0x270 [gfs2]
[ 3992.649455]  ? inode_security+0x22/0x60
[ 3992.649462]  ? selinux_file_permission+0x104/0x150
[ 3992.649465]  aio_write+0x116/0x230
[ 3992.649471]  ? _copy_to_user+0x1c/0x30
[ 3992.649475]  ? aio_read_events_ring+0x20c/0x290
[ 3992.649478]  ? fget+0x7c/0xb0
[ 3992.649482]  ? io_submit_one+0xde/0x3c0
[ 3992.649484]  io_submit_one+0xde/0x3c0
[ 3992.649487]  __x64_sys_io_submit+0x80/0x170
[ 3992.649490]  ? __audit_syscall_exit+0x24d/0x2a0
[ 3992.649494]  do_syscall_64+0x3b/0x90
[ 3992.649500]  entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 3992.649504] RIP: 0033:0x7efcb1890dfd
[ 3992.649507] Code: ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d fb 5f 1b 00 f7 d8 64 89 01 48
[ 3992.649509] RSP: 002b:00007ffda23bb4a8 EFLAGS: 00000246 ORIG_RAX: 00000000000000d1
[ 3992.649512] RAX: ffffffffffffffda RBX: 00007efcb184bf70 RCX: 00007efcb1890dfd
[ 3992.649513] RDX: 000055e925ce16b8 RSI: 0000000000000001 RDI: 00007efc9be4f000
[ 3992.649515] RBP: 00007efc9be4f000 R08: 000055e925cf0000 R09: 0000000000000018
[ 3992.649517] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000001
[ 3992.649518] R13: 0000000000000000 R14: 000055e925ce16b8 R15: 000055e925ce15c0
[ 3992.649521] Modules linked in: gfs2 dlm emcpdm(POE) emcpgpx(POE) emcpmpx(POE) emcp(POE) nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs snd_seq_dummy snd_hrtimer snd_seq snd_timer snd_seq_device snd soundcore qrtr rfkill sunrpc intel_rapl_msr iTCO_wdt iTCO_vendor_support dcdbas intel_rapl_common sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass rapl intel_cstate intel_uncore pcspkr ipmi_ssif mxm_wmi mlx5_ib lpc_ich mei_me mei ib_uverbs ib_core ipmi_si acpi_power_meter xfs libcrc32c sr_mod cdrom sd_mod sg mgag200 drm_kms_helper qla2xxx mlx5_core syscopyarea sysfillrect sysimgblt fb_sys_fops cec crct10dif_pclmul ahci crc32_pclmul drm ixgbe crc32c_intel nvme_fc libahci ghash_clmulni_intel megaraid_sas nvme_fabrics libata nvme_core mlxfw mdio dca psample tls t10_pi i2c_algo_bit scsi_transport_fc pci_hyperv_intf wmi dm_mirror dm_region_hash dm_log dm_mod ipmi_devintf ipmi_msghandler fuse [last unloaded: emcpioc]

Environment

  • Red Hat Enterprise Linux Server 8, 9 (with the High Availability Add On and Resilient Storage Add Ons)
  • A Global Filesystem 2(gfs2)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content