Oracle RAC cssdmonitor invoked the sysrq-c crash for node eviction

Solution In Progress - Updated -

Issue

Oracle cssdmonitor invoked the sysrq-c crash for node eviction:

[331186.202673] SysRq : Trigger a crash
[331186.202711] BUG: unable to handle kernel NULL pointer dereference at           (null)
[331186.202730] IP: [<ffffffffba6755a6>] sysrq_handle_crash+0x16/0x20
[331186.202750] PGD 0 
[331186.202756] Oops: 0002 [#1] SMP 
[331186.202767] Modules linked in: oracleacfs(POE) oracleadvm(POE) oracleoks(POE) gsch(OE) redirfs(OE) bmhook(OE) tmhook(OE) dsa_filter(POE) dsa_filter_hook(OE) rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache oracleasm(O) rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp ib_ipoib rdma_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr ib_core ipmi_ssif sg joydev mei_me mei lpc_ich wmi ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad binfmt_misc auth_rpcgss sunrpc ip_tables xfs libcrc32c dm_service_time sd_mod crc_t10dif crct10dif_generic mgag200
[331186.202974]  i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci fnic crct10dif_pclmul crct10dif_common libfcoe crc32c_intel drm libfc libahci libata enic scsi_transport_fc scsi_tgt drm_panel_orientation_quirks nfit libnvdimm dm_multipath dm_mirror dm_region_hash dm_log dm_mod
[331186.203052] CPU: 8 PID: 12268 Comm: cssdmonitor Kdump: loaded Tainted: P           OE  ------------   3.10.0-1160.59.1.el7.x86_64 #1
[331186.203078] Hardware name: Cisco Systems Inc UCSB-B200-M5/UCSB-B200-M5, BIOS B200M5.4.0.2c.0.0204190150 02/04/2019
[331186.203100] task: ffff88b848d48000 ti: ffff88b84b4d0000 task.ti: ffff88b84b4d0000
[331186.203116] RIP: 0010:[<ffffffffba6755a6>]  [<ffffffffba6755a6>] sysrq_handle_crash+0x16/0x20
[331186.203136] RSP: 0018:ffff88b84b4d3d40  EFLAGS: 00010246
[331186.203148] RAX: ffffffffba675590 RBX: ffffffffbaee74a0 RCX: 0000000000000000
[331186.203163] RDX: 0000000000000000 RSI: ffff88ccfc0138d8 RDI: 0000000000000063
[331186.203177] RBP: ffff88b84b4d3d40 R08: ffffffffbb20487c R09: ffff88bf606a0500
[331186.203193] R10: 0000000000000d31 R11: 0000000000000d30 R12: 0000000000000063
[331186.203208] R13: 0000000000000000 R14: 0000000000000004 R15: 00007fe3b00380b0
[331186.203223] FS:  00007fe3e5f81700(0000) GS:ffff88ccfc000000(0000) knlGS:0000000000000000
[331186.203241] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[331186.203253] CR2: 0000000000000000 CR3: 0000000b68428000 CR4: 00000000007607e0
[331186.203269] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[331186.203284] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[331186.203298] PKRU: 55555554
[331186.203305] Call Trace:
[331186.203314]  [<ffffffffba675dcd>] __handle_sysrq+0x10d/0x170
[331186.203328]  [<ffffffffba676238>] write_sysrq_trigger+0x28/0x40
[331186.203343]  [<ffffffffba4c7770>] proc_reg_write+0x40/0x80
[331186.203356]  [<ffffffffba44e590>] vfs_write+0xc0/0x1f0
[331186.203369]  [<ffffffffba44f36f>] SyS_write+0x7f/0xf0
[331186.203383]  [<ffffffffba98b8a2>] ? down_read+0x12/0x40
[331186.203398]  [<ffffffffc0e55cf5>] tmhook_invoke.isra.8+0x45/0x90 [tmhook]
[331186.203414]  [<ffffffffc0e55ee8>] tmhook_handler+0x1a8/0x2c0 [tmhook]
[331186.203430]  [<ffffffffba999f92>] system_call_fastpath+0x25/0x2a
[331186.203443] Code: eb 9b 45 01 f4 45 39 65 34 75 e5 4c 89 ef e8 e2 f7 ff ff eb db 0f 1f 44 00 00 55 48 89 e5 c7 05 31 29 7d 00 01 00 00 00 0f ae f8 <c6> 04 25 00 00 00 00 01 5d c3 0f 1f 44 00 00 55 31 c0 c7 05 ae 
[331186.203531] RIP  [<ffffffffba6755a6>] sysrq_handle_crash+0x16/0x20
[331186.204138]  RSP <ffff88b84b4d3d40>
[331186.204726] CR2: 0000000000000000

Environment

  • Red Hat Enterprise Linux (RHEL) 7
  • Red Hat Enterprise Linux (RHEL) 8
  • Oracle RAC

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content