The kernel crashes due to Oracle RAC cluster fencing, which is triggered when ocssd.bin is unexpectedly terminated by SIGABRT and dumping core

Issue

• The kernel crashes due to Oracle RAC cluster fencing, which is triggered when ocssd.bin is unexpectedly terminated by SIGABRT and dumping core.

Feb 17 18:18:16 hostname systemd-coredump[3499202]: Process 9143 (ocssd.bin) of user 2101 dumped core.#012#012Stack trace of thread 9878:#012#0  0x00007ff9908e352f raise (libc.so.6)#012#1  0x00007ff9908b6e65 abort (libc.so.6)#012#2  0x00007ff996259483 skgdbgcra (libclntsh.so.19.1)#012#3  0x00007ff998b6eede clsbSigErrCB (libhasgen19.so)#012#4  0x00007ff996224442 skgesig_sigactionHandler (libclntsh.so.19.1)#012#5  0x00007ff9927eed10 __restore_rt (libpthread.so.0)#012#6  0x00007ff9908e352f raise (libc.so.6)#012#7  0x00007ff9908b6e65 abort (libc.so.6)#012#8  0x00007ff99357dbbc slzabort (libclntshcore.so.19.1)#012#9  0x0000560b3c2e7d24 clssscExit (ocssd.bin)#012#10 0x0000560b3c2402aa clssnmvKillBlockThread (ocssd.bin)#012#11 0x0000560b3c2cce31 clssscthrdmain (ocssd.bin)#012#12 0x00007ff9927e41ca start_thread (libpthread.so.0)#012#13 0x00007ff9908ce8d3 __clone (libc.so.6)#012#012Stack trace of thread 9598:#012#0  0x00007ff9927ea47c pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)#012#1  0x00007ff99357c552 sltspcwait (libclntshcore.so.19.1)#012#2  0x00007ff99896c9e6 sgipcwWait (libhasgen19.so)#012#3  0x00007ff9987f4f0b gipcWaitOsd (libhasgen19.so)#012#4  0x00007ff9987f74d4 gipcInternalWaitEpoll (libhasgen19.so)#012#5  0x00007ff9987f206b gipcInternalWait (libhasgen19.so)#012#6  0x00007ff9987b72cf gipcWaitF (libhasgen19.so)#012#7  0x00007ff998e32f78 EvmConWait (libhasgen19.so)#012#8  0x00007ff998e2a02f EvmConnWaitInternal (libhasgen19.so)#012#9  0x00007ff998e29fcb EvmConnWait (libhasgen19.so)#012#10 0x00007ff998e299ff _evmConnWaitForAcknowledgement (libhasgen19.so)#012#11 0x00007ff998e2a691 EvmEventPost (libhasgen19.so)#012#12 0x00007ff998e23644 clsce_publish_internal (libhasgen19.so)#012#13 0x00007ff998b30c73 clscal_repository_write_dqpub_thr (libhasgen19.so)#012#14 0x00007ff9927e41ca start_thread (libpthread.so.0)#012#15 0x00007ff9908ce8d3 __clone (libc.so.6)#012#012Stack trace of thread 9599:#012#0  0x00007ff9909d4307 epoll_wait (libc.so.6)#012#1  0x00007ff99896cca4 sgipcwWait (libhasgen19.so)#012#2  0x00007ff9987f4f0b gipcWaitOsd (libhasgen19.so)#012#3  0x00007ff9987f74d4 gipcInternalWaitEpoll (libhasgen19.so)#012#4  0x00007ff9987f206b gipcInternalWait (libhasgen19.so)#012#5  0x00007ff9987b72cf gipcWaitF (libhasgen19.so)#012#6  0x00007ff998603f8f clsdms_thdmai (libhasgen19.so)#012#7  0x00007ff9927e41ca start_thread (libpthread.so.0)#012#8  0x00007ff9908ce8d3 __clone (libc.so.6)#012#012Stack trace of thread 9617:#012#0  0x00007ff9927ed84d __lll_lock_wait (libpthread.so.0)#012#1  0x00007ff9927e6ac9 __pthread_mutex_lock (libpthread.so.0)#012#2  0x0000560b3c2e7cfc clssscExit (ocssd.bin)#012#3  0x0000560b3c25ca6d clssgmclientlsnr (ocssd.bin)#012#4  0x0000560b3c2cce31 clssscthrdmain (ocssd.bin)#012#5  0x00007ff9927e41ca start_thread (libpthread.so.0)#012#6  0x00007ff9908ce8d3 __clone (libc.so.6)#012#012Stack trace of thread 9596:#012#0  0x00007ff9927ea868 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)#012#1  0x00007ff99357c5f1 sltspctimewait (libclntshcore.so.19.1)#012#2  0x00007ff99865a924 clsucvtimewait (libhasgen19.so)#012#3  0x00007ff9988e231f gipcMonitorDomainSocketThreadEntry (libhasgen19.so)#012#4  0x00007ff9927e41ca start_thread (libpthread.so.0)#012#5  0x00007ff9908ce8d3 __clone (libc.so.6)#012#012Stack trace of thread 9143:#012#0  0x00007ff9927ea868 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)#012#1  0x00007ff99357c5f1 sltspctimewait (libclntshcore.so.19.1)#012#2  0x00007ff99865a924 clsucvtimewait (libhasgen19.so)#012#3  0x0000560b3c1ca5d6 clssnmNMGetStatus (ocssd.bin)#012#4  0x0000560b3c1ba423 clssgmStartNMMon (ocssd.bin)#012#5  0x0000560b3c155922 clssscmain (ocssd.bin)#012#6  0x00007ff998b6b947 clsbCMain (libhasgen19.so)#012#7  0x0000560b3c154848 main (ocssd.bin)#012#8  0x00007ff9908cf7e5 __libc_start_main (libc.so.6)#012#9  0x0000560b3c154519 _start (ocssd.bin)#012#012Stack trace of thread 9611:#012#0  0x00007ff9927ea868 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)#012#1  0x00007ff99357c5f1 sltspctimewait (libclntshcore.so.19.1)#012#2  0x00007ff99865a924 clsucvtimewait (libhasgen19.so)#012#3  0x0000560b3c2e1582 clssscWaitChangeEventValue (ocssd.bin)#012#4  0x0000560b3c19aa15 clssgmPeerWorkerThread (ocssd.bin)#012#5  0x0000560b3c2cce31 clssscthrdmain (ocssd.bin)#012#6  0x00007ff9927e41ca start_thread (libpthread.so.0)#012#7  0x00007ff9908ce8d3 __clone (libc.so.6)#012#012Stack trace of thread 9384:#012#0  0x00007ff9927ea868 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)#012#1  0x00007ff99357c5f1 sltspctimewait (libclntshcore.so.19.1)#012#2  0x00007ff9986ddf16 clsdadr_bucketThread@@@                                                                                                                                                                              
        ...
Feb 17 18:18:16 hostname systemd[1]: systemd-coredump@0-3499201-0.service: Succeeded.
Feb 17 18:18:16 hostname systemd[1]: systemd-coredump@0-3499201-0.service: Succeeded.
Feb 17 18:18:16 hostname systemd[1]: systemd-coredump@0-3499201-0.service: Succeeded.
        ...
Feb 17 18:18:16 hostname kernel: sysrq: SysRq : Trigger a crash
Feb 17 18:18:16 hostname kernel: sysrq: SysRq : Trigger a crash
Feb 17 18:18:16 hostname kernel: sysrq: SysRq : Trigger a crash
Feb 17 18:18:16 hostname kernel: Kernel panic - not syncing: sysrq triggered crash
Feb 17 18:18:16 hostname kernel: Kernel panic - not syncing: sysrq triggered crash
Feb 17 18:18:16 hostname kernel: Kernel panic - not syncing: sysrq triggered crash