OSP 16.1: kernel panic at nfs4_select_rw_stateid+0x64

Issue

• Kernel panic with below log:

[39102680.148802] BUG: unable to handle kernel paging request at 0000000000001040
[39102680.235815] PGD 0 P4D 0 
[39102680.269370] Oops: 0000 [#1] SMP NOPTI
[39102680.316552] CPU: 48 PID: 963648 Comm: kworker/u131:0 Kdump: loaded Not tainted 4.18.0-193.14.3.el8_2.x86_64 #1
[39102680.440253] Hardware name: HPE ProLiant DL360 Gen10/ProLiant DL360 Gen10, BIOS U32 05/24/2021
[39102680.546168] Workqueue: rpciod rpc_async_schedule [sunrpc]
[39102680.614346] RIP: 0010:nfs4_select_rw_stateid+0x64/0x180 [nfsv4]
[39102680.688785] Code: 41 89 f6 48 89 fb 48 85 d2 0f 84 f6 00 00 00 48 8b 47 40 a8 01 0f 84 ea 00 00 00 48 8b 42 18 4c 8b 7a 20 4c 8d 67 48 4c 89 e7 <48> 8b 50 40 48 89 54 24 08 e8 4e 8e 90 d5 48 8b 54 24 08 4c 89 fe
[39102680.918345] RSP: 0018:ffff9d1b30517dc0 EFLAGS: 00010202
[39102680.984396] RAX: 0000000000001000 RBX: ffff8cbe4b0a1800 RCX: ffff8d03c869e408
[39102681.073503] RDX: ffff8c8c2959e2c0 RSI: 0000000000000001 RDI: ffff8cbe4b0a1848
[39102681.162610] RBP: ffff9d1b30517e00 R08: 0000000000000000 R09: 0000646f69637072
[39102681.251719] R10: 8080808080808080 R11: ffff8d54a4d2a7a8 R12: ffff8cbe4b0a1848
[39102681.340819] R13: ffff8d03c869e408 R14: 0000000000000001 R15: ffff8d149c0e3440
[39102681.429925] FS:  0000000000000000(0000) GS:ffff8d14bfa00000(0000) knlGS:0000000000000000
[39102681.530563] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[39102681.602899] CR2: 0000000000001040 CR3: 000000a9a640a004 CR4: 00000000007626e0
[39102681.692008] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[39102681.781116] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[39102681.870226] PKRU: 55555554
[39102681.905875] Call Trace:
[39102681.938419]  ? nfs4_setup_sequence+0x36/0x190 [nfsv4]
[39102682.002407]  ? rpc_exit+0x30/0x30 [sunrpc]
[39102682.054860]  ? __rpc_atrun+0x20/0x20 [sunrpc]
[39102682.110455]  nfs4_proc_pgio_rpc_prepare+0x5c/0x80 [nfsv4]
[39102682.178621]  nfs_pgio_prepare+0x2d/0x40 [nfs]
[39102682.234228]  __rpc_execute+0x85/0x340 [sunrpc]
[39102682.290847]  ? finish_task_switch+0xd7/0x2b0
[39102682.345377]  rpc_async_schedule+0x29/0x40 [sunrpc]
[39102682.406185]  process_one_work+0x1a7/0x3b0
[39102682.457555]  worker_thread+0x30/0x390
[39102682.504737]  ? create_worker+0x1a0/0x1a0
[39102682.555062]  kthread+0x112/0x130
[39102682.597004]  ? kthread_flush_work_fn+0x10/0x10
[39102682.653618]  ret_from_fork+0x1f/0x40
[39102682.699751] Modules linked in: bluetooth ecdh_generic rfkill binfmt_misc veth vhost_net vhost nf_conntrack_netlink tap tun nfs_layout_nfsv41_files rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache xsk_diag raw_diag unix_diag af_packet_diag netlink_diag tcp_diag udp_diag inet_diag geneve ip6_udp_tunnel udp_tunnel nf_log_ipv6 nf_log_ipv4 nf_log_common nft_limit xt_LOG xt_limit xt_multiport nft_counter xt_comment xt_state xt_conntrack nft_compat overlay nf_tables br_netfilter bridge stp llc sch_ingress bonding nfnetlink_cttimeout nfnetlink openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_defrag_ipv6 nf_conncount nf_nat nf_conntrack nls_utf8 isofs ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp ib_ipoib ib_umad iw_cxgb4 rpcrdma rdma_ucm ib_iser rdma_cm intel_rapl_msr iw_cm intel_rapl_common ib_cm nfit libnvdimm x86_pkg_temp_thermal intel_powerclamp coretemp bnxt_re ipmi_ssif kvm_intel ib_uverbs ib_core
[39102682.699790]  kvm irqbypass intel_cstate intel_uncore ipmi_si mei_me ses ipmi_devintf pcspkr intel_rapl_perf lpc_ich hpwdt enclosure joydev ioatdma hpilo mei wmi ipmi_msghandler acpi_tad acpi_power_meter ip_tables xfs libcrc32c dm_multipath sd_mod sg mgag200 drm_vram_helper drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crc32_pclmul crc32c_intel drm igb ghash_clmulni_intel smartpqi bnxt_en scsi_transport_sas dca i2c_algo_bit sunrpc dm_mirror dm_region_hash dm_log dm_mod be2iscsi bnx2i cnic uio cxgb4i cxgb4 libcxgbi libcxgb qla4xxx iscsi_boot_sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi
[39102684.436674] CR2: 0000000000001040