RHEL 8.4: panic while killing an already dead dentry in overlayfs

Issue

• Kernel crashed with below log:

156012.504727] overlayfs: unrecognized mount option "volatile" or missing value
[156016.759412] overlayfs: unrecognized mount option "volatile" or missing value
[156017.762915] overlayfs: unrecognized mount option "volatile" or missing value
[156045.937293] overlayfs: unrecognized mount option "volatile" or missing value
[156086.666600] list_del corruption. prev->next should be ffff8b2872c3d090, but was ffff8b2659188ca0
[156086.666826] ------------[ cut here ]------------
[156086.666931] kernel BUG at lib/list_debug.c:53!
[156086.667063] invalid opcode: 0000 [#1] SMP PTI
[156086.667165] CPU: 0 PID: 2275362 Comm: openshift-sti-b Kdump: loaded Not tainted 4.18.0-305.40.2.el8_4.x86_64 #1
[156086.667385] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
[156086.667625] RIP: 0010:__list_del_entry_valid.cold.1+0x34/0x4c
[156086.667755] Code: 68 d0 a6 e8 48 a3 cb ff 0f 0b 48 c7 c7 e8 68 d0 a6 e8 3a a3 cb ff 0f 0b 48 89 f2 48 89 fe 48 c7 c7 a8 68 d0 a6 e8 26 a3 cb ff <0f> 0b 48 89 fe 48 c7 c7 70 68 d0 a6 e8 15 a3 cb ff 0f 0b 90 90 90
[156086.668158] RSP: 0018:ffffa59607aefda0 EFLAGS: 00010246
[156086.668277] RAX: 0000000000000054 RBX: ffff8b2872c3d000 RCX: 0000000000000000
[156086.668438] RDX: 0000000000000000 RSI: ffff8b28dfc16808 RDI: ffff8b28dfc16808
[156086.668600] RBP: ffff8b2659188c00 R08: 0000000000000b0b R09: 0000000000aaaaaa
[156086.668765] R10: 0000000000000000 R11: ffffa596045f1600 R12: ffff8b2872c3d058
[156086.668924] R13: ffff8b23565c3598 R14: ffff8b2477d1a580 R15: ffff8b2872c3d000
[156086.669093] FS:  00007f934a5f5700(0000) GS:ffff8b28dfc00000(0000) knlGS:0000000000000000
[156086.669275] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[156086.669405] CR2: 0000559cc22fb478 CR3: 00000001a9bce003 CR4: 00000000003706f0
[156086.669599] Call Trace:
[156086.669665]  __dentry_kill+0x7d/0x170
[156086.669757]  dentry_kill+0x4d/0x190
[156086.669842]  shrink_dentry_list+0xbf/0x1b0
[156086.669937]  shrink_dcache_parent+0x88/0x90
[156086.670046]  do_one_tree+0xe/0x40
[156086.670123]  shrink_dcache_for_umount+0x28/0x80
[156086.670250]  generic_shutdown_super+0x1a/0x100
[156086.670358]  kill_anon_super+0x14/0x30
[156086.670444]  deactivate_locked_super+0x34/0x70
[156086.670548]  cleanup_mnt+0x3b/0x70
[156086.670630]  task_work_run+0x8a/0xb0
[156086.670715]  exit_to_usermode_loop+0xeb/0xf0
[156086.670813]  do_syscall_64+0x198/0x1a0
[156086.670903]  entry_SYSCALL_64_after_hwframe+0x65/0xca
[156086.671018] RIP: 0033:0xd9f43b
[156086.671698] Code: fa ff eb bd e8 66 7b fa ff e9 61 ff ff ff cc e8 fb 45 fa ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 28 ff ff ff ff 48 c7 44 24 30
[156086.673146] RSP: 002b:000000c0007f2bd0 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
[156086.673848] RAX: 0000000000000000 RBX: 000000c000071800 RCX: 0000000000d9f43b
[156086.674527] RDX: 0000000000000000 RSI: 0000000000000002 RDI: 000000c0001d9260
[156086.675203] RBP: 000000c0007f2c28 R08: 0000000000000000 R09: 0000000000000000
[156086.675872] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000000
[156086.676527] R13: 0000000000000001 R14: 000000000000002b R15: ffffffffffffffff
[156086.677183] Modules linked in: nbd nfsv3 nfs_acl veth nf_conntrack_netlink xt_recent xt_statistic xt_nat xt_addrtype ipt_REJECT nf_reject_ipv4 xt_CT rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace sunrpc fscache ip6t_MASQUERADE ipt_MASQUERADE xt_conntrack xt_comment nft_counter xt_mark nft_compat nft_chain_nat nf_tables vxlan ip6_udp_tunnel udp_tunnel nfnetlink_cttimeout nfnetlink openvswitch nf_conncount nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vsock_loopback vmw_vsock_virtio_transport_common vmw_vsock_vmci_transport vsock overlay ext4 mbcache jbd2 vmwgfx ttm drm_kms_helper intel_rapl_msr intel_rapl_common syscopyarea sysfillrect sb_edac vmw_balloon sysimgblt rapl fb_sys_fops drm joydev pcspkr vmw_vmci i2c_piix4 ip_tables xfs libcrc32c ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel sd_mod t10_pi sg ata_piix ghash_clmulni_intel libata serio_raw vmxnet3 vmw_pvscsi dm_multipath dm_mirror dm_region_hash dm_log dm_mod be2iscsi bnx2i cnic uio cxgb4i cxgb4
[156086.677218]  libcxgbi libcxgb qla4xxx iscsi_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi fuse scsi_transport_iscsi