RHEL8: Kernel panic from xprt_complete_rqst+0x31

Issue

• Kernel panic with logs:

[357689.766892] general protection fault, probably for non-canonical address 0xdead000000000100: 0000 [#1] SMP NOPTI
[357689.766960] CPU: 26 PID: 6791 Comm: nfsd Kdump: loaded Not tainted 4.18.0-553.42.1.el8_10.x86_64 #1
[357689.767012] Hardware name: HPE ProLiant XL450 Gen10/ProLiant XL450 Gen10, BIOS U40 04/20/2023
[357689.767059] RIP: 0010:rb_erase+0x226/0x3b0
[357689.767090] Code: ff 4d 89 48 10 e9 85 fe ff ff c3 cc cc cc cc 48 89 06 48 89 d0 48 8b 52 10 e9 a1 fe ff ff 48 8b 07 48 89 c1 48 83 e1 fc 74 57 <48> 3b 79 10 0f 84 a4 00 00 00 4c 89 41 08 4d 85 c0 75 50 a8 01 0f
[357689.767183] RSP: 0018:ffff9a7ca4e5fdd8 EFLAGS: 00010286
[357689.767213] RAX: dead000000000100 RBX: ffff8eebbbc5c000 RCX: dead000000000100
[357689.767256] RDX: 0000000000000000 RSI: ffff8eebbbc5c6d0 RDI: ffff8ef999a982c8
[357689.767290] RBP: ffff8f1002a6ebc0 R08: dead000000000200 R09: ffff8ee35b01f200
[357689.767331] R10: ffffffff9ad48c64 R11: 0000000000000012 R12: ffff8f06b1241000
[357689.767369] R13: ffff8eebbbc5c680 R14: ffff8eebbbc5c000 R15: 000000008a7bfd18
[357689.767409] FS:  0000000000000000(0000) GS:ffff8f11df400000(0000) knlGS:0000000000000000
[357689.767440] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[357689.767462] CR2: 00007f917fee7300 CR3: 00000009a3210006 CR4: 00000000007706e0
[357689.767491] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[357689.767532] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[357689.767573] PKRU: 55555554
[357689.767593] Call Trace:
[357689.767610]  ? __die_body+0x1a/0x60
[357689.767637]  ? die_addr+0x38/0x51
[357689.767657]  ? do_general_protection+0x135/0x280
[357689.767683]  ? general_protection+0x1e/0x30
[357689.767710]  ? rb_erase+0x226/0x3b0
[357689.767730]  xprt_complete_rqst+0x31/0x50 [sunrpc]
[357689.767785]  svc_tcp_recvfrom+0x692/0x6d0 [sunrpc]
[357689.767846]  svc_recv+0x745/0x7e0 [sunrpc]
[357689.767906]  ? nfsd_shutdown_threads+0x80/0x80 [nfsd]
[357689.767961]  nfsd+0xd1/0x140 [nfsd]
[357689.767997]  kthread+0x134/0x150
[357689.768015]  ? set_kthread_struct+0x50/0x50
[357689.768034]  ret_from_fork+0x1f/0x40
[357689.768052] Modules linked in: nfsv4 dns_resolver nfs fscache binfmt_misc rpcsec_gss_krb5 8021q garp mrp stp llc nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nf_tables_set nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables nfnetlink vfat fat intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common isst_if_common nfit libnvdimm x86_pkg_temp_thermal intel_powerclamp coretemp crct10dif_pclmul crc32_pclmul ghash_clmulni_intel rapl intel_cstate rpcrdma rdma_ucm ib_srpt ib_isert iscsi_target_mod target_core_mod ib_iser libiscsi scsi_transport_iscsi ib_umad rdma_cm ib_ipoib iw_cm ib_cm irdma ipmi_ssif ice mlx5_ib ib_uverbs cdc_eem ib_core acpi_ipmi intel_uncore ses mei_me usbnet enclosure pcspkr joydev mii scsi_transport_sas mei ioatdma hpwdt ipmi_si hpilo lpc_ich dca ipmi_devintf wmi ipmi_msghandler acpi_tad acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace dm_mod
[357689.768124]  sunrpc xfs libcrc32c raid1 sd_mod t10_pi sg mlx5_core mgag200 drm_kms_helper syscopyarea i40e sysfillrect sysimgblt i2c_algo_bit mlxfw ahci drm_shmem_helper pci_hyperv_intf libahci tls drm uas crc32c_intel libata megaraid_sas tg3 psample usb_storage fuse