Kernel panic at 'cxiStartIO+0x70' due to involvement of third party module [mmfslinux].

Solution Verified - Updated -

Issue

  • Kernel panic occurred at cxiStartIO() function due to 3rd party module [mmfslinux]
  • Kernel panics with following messages:
[348963.925577] BUG: Unable to handle kernel data access at 0xfffffffffffffffa
[348963.925584] Faulting instruction address: 0xc00800000955d1e8
[348963.925591] Oops: Kernel access of bad area, sig: 11 [#1]
[348963.925594] LE PAGE_SIZE=64K MMU=Radix SMP NR_CPUS=2048 NUMA pSeries
[348963.925600] Modules linked in: ib_core overlay nf_tables nfnetlink mmfs26(OE) mmfslinux(OE) tracedev(OE) rpadlpar_io rpaphp nfsv3 nfs_acl rpcsec_gss_krb5 xsk_diag nfsv4 dns_resolver nfs lockd grace fscache netfs bonding tls rfkill binfmt_misc pseries_rng auth_rpcgss drm sunrpc drm_panel_orientation_quirks xfs libcrc32c dm_round_robin sd_mod t10_pi sg ibmvfc scsi_transport_fc ibmveth vmx_crypto pseries_wdt dm_multipath dm_mirror dm_region_hash dm_log dm_mod fuse
[348963.925647] CPU: 5 PID: 259446 Comm: mmfsd Kdump: loaded Tainted: G           OE     -------  ---  5.14.0-503.38.1.el9_5.ppc64le #1
[348963.925652] NIP:  c00800000955d1e8 LR: c00800000955d1e8 CTR: c0000000004ba4e0
[348963.925654] REGS: c0000007549c7560 TRAP: 0380   Tainted: G           OE     -------  ---   (5.14.0-503.38.1.el9_5.ppc64le)
[348963.925657] MSR:  8000000000009033 <SF,EE,ME,IR,DR,RI,LE>  CR: 84442230  XER: 00000000
[348963.925664] CFAR: c0080000095217e8 IRQMASK: 0
                GPR00: c00800000955d1e8 c0000007549c7800 c008000009598000 fffffffffffffffa
                GPR04: 0000000000cda7f6 c0000006ebf02190 0000000000000000 c000000efd9b4e98
                GPR08: 0000000000cda7f5 0000000000000000 0000000000000000 c00800000956c188
                GPR12: c0000000004ba4e0 c000000effff9080 c008000009deb708 c008000009bfc084
                GPR16: c008000009bfc198 c008000009deb738 0000000000000000 c008000009deb5c8
                GPR20: c0000000833d8680 0000000000000001 c0000007549c7b10 c008000007d79ef0
                GPR24: c00800000837d500 0000000000000060 0000000000000000 c008000009bfc198
                GPR28: c00800000837d500 0000000000000000 0000000000000060 c00800000837d500
[348963.925688] NIP [c00800000955d1e8] cxiStartIO+0x70/0xaa4 [mmfslinux]
[348963.925718] LR [c00800000955d1e8] cxiStartIO+0x70/0xaa4 [mmfslinux]
[348963.925739] Call Trace:
[348963.925816] [c0000007549c7800] [c00800000955d1e8] cxiStartIO+0x70/0xaa4 [mmfslinux] (unreliable)
[348963.925892] [c0000007549c7990] [c008000009bfd1fc] _ZN9DiskSched7localIOEPP15MBDoDiskIOParmsiiP15KernelOperation+0x558/0xb6c [mmfs26]
[348963.925931] [c0000007549c7af0] [c008000009bfdb4c] kxLocalIO+0x17c/0x264 [mmfs26]
[348963.925964] [c0000007549c7b70] [c008000009cd6674] _Z8ss_ioctljm+0x73c/0x1f5c [mmfs26]
[348963.926085] [c0000007549c7c60] [c008000009537ca8] doSSIoctl+0x500/0x7bc [mmfslinux]
[348963.926140] [c0000007549c7d40] [c008000009537f88] ss_fs_unlocked_ioctl+0x24/0x3c [mmfslinux]
[348963.926165] [c0000007549c7d60] [c0000000005f57f4] sys_ioctl+0xf4/0x160
[348963.926176] [c0000007549c7db0] [c00000000002ef44] system_call_exception+0x164/0x310
[348963.926183] [c0000007549c7e10] [c00000000000bfe8] system_call_vectored_common+0xe8/0x278
[348963.926190] --- interrupt: 3000 at 0x7fff8813c204
[348963.926194] NIP:  00007fff8813c204 LR: 0000000000000000 CTR: 0000000000000000
[348963.926196] REGS: c0000007549c7e80 TRAP: 3000   Tainted: G           OE     -------  ---   (5.14.0-503.38.1.el9_5.ppc64le)
[348963.926199] MSR:  800000000280f033 <SF,VEC,VSX,EE,PR,FP,ME,IR,DR,RI,LE>  CR: 42442234  XER: 00000000
[348963.926207] IRQMASK: 0
                GPR00: 0000000000000036 00007ffd9b9ec700 0000000011d96c00 0000000000000004
                GPR04: 000000000000001b 00007ffd9b9ec780 000000007fffffff 000000006818c9d8
                GPR08: 0000000000100000 0000000000000000 0000000000000000 0000000000000000
                GPR12: 0000000000000000 00007ffd9ba05ea0 00007ffd9b9ed098 00000000121824f8
                GPR16: 00000000121a50b8 0000000000000001 00007ffd9b9ecc98 00007ffd9b9ecc90
                GPR20: 00000000121824f8 0000000030701c4d 0000000000000001 0000000000000000
                GPR24: 0000000000000000 0000018009a2dac0 0000000000000000 0000000030701c4c
                GPR28: 000001800837d500 00007ffd9b9eca70 0000000011d8f1a8 00007ffe8004f480

Environment

  • Red Hat Enterprise Linux 9
  • A third party kernel [mmfslinux] module.
  • Kernel-5.14.0-503.38.1.el9_5.ppc64le

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content