Java crash in libc.so.6 in _int_malloc

Issue

• Java crashes with Automatic Bug Reporting Tool (ABRT) enabled.
• A fatal error log is not created.
• The fatal error header sent to standard out shows the following:

# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007f9e9c7e4602, pid=7304, tid=0x00007f9e7488a700
#
# JRE version: OpenJDK Runtime Environment (8.0_222-b10) (build 1.8.0_222-b10)
# Java VM: OpenJDK 64-Bit Server VM (25.222-b10 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C  [libc.so.6+0x82602]# [ timer expired, abort... ]
*** JBossAS process (7304) received ABRT signal ***
7304

• The backtrace shows the current thread is WatcherThread:

Thread 1 (Thread 0x7f57b124e700 (LWP 31949)):
#0  0x00007f57d48f0377 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:55
#1  0x00007f57d48f1a68 in __GI_abort () at abort.c:90
#2  0x00007f57d418db49 in os::die () at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/os/linux/vm/os_linux.cpp:1585
#3  0x00007f57d433b223 in WatcherThread::run (this=0x247c000) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/runtime/thread.cpp:1379
#4  0x00007f57d418ca72 in java_start (thread=0x247c000) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/os/linux/vm/os_linux.cpp:847
#5  0x00007f57d52b8ea5 in start_thread (arg=0x7f57b124e700) at pthread_create.c:307
#6  0x00007f57d49b88cd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

• The backtrace shows a thread crashing doing malloc:

Thread 41 (Thread 0x7f57a6e74700 (LWP 32048)):
#0  __lll_lock_wait_private () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:95
#1  0x00007f57d4942b35 in _L_lock_17166 () at malloc.c:5197
#2  0x00007f57d493fb73 in __GI___libc_malloc (bytes=140015208765280) at malloc.c:2903
#3  0x00007f57d418470d in os::malloc (size=size@entry=24, memflags=memflags@entry=mtInternal, stack=...)
    at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/runtime/os.cpp:637
#4  0x00007f57d3dc0b87 in AllocateHeap (alloc_failmode=AllocFailStrategy::RETURN_NULL, stack=..., flags=mtInternal, size=24)
    at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/memory/allocation.inline.hpp:56
#5  CHeapObj<(MemoryType)7>::operator new (stack=..., nothrow_constant=..., size=24)
    at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/memory/allocation.inline.hpp:113
#6  0x00007f57d3dc0bfd in CHeapObj<(MemoryType)7>::operator new (nothrow_constant=..., size=24)
    at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/memory/allocation.inline.hpp:122
#7  0x00007f57d3dc101d in create_decoder () at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/utilities/decoder.cpp:74
#8  get_error_handler_instance () at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/utilities/decoder.cpp:59
#9  Decoder::decode (addr=0x831a8 <Address 0x831a8 out of bounds>, buf=0x7f57d48b51a0 <VMError::report(outputStream*)::buf> "/lib64/libc.so.6", buflen=2000, offset=0x7f57a6e71ed0,
    modulepath=0x7f57d56e2ed0 "/lib64/libc.so.6") at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/utilities/decoder.cpp:108
#10 0x00007f57d418dc96 in os::dll_address_to_function_name (addr=addr@entry=0x7f57d493d1a8 <_int_malloc+3736> "L;h(uWI\213U(L;j uMI\203|$ ",
    buf=buf@entry=0x7f57d48b51a0 <VMError::report(outputStream*)::buf> "/lib64/libc.so.6", buflen=buflen@entry=2000, offset=offset@entry=0x7f57a6e71ed0)
    at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/os/linux/vm/os_linux.cpp:1728
#11 0x00007f57d3e4ca22 in frame::print_C_frame (st=st@entry=0x7f57a6e72610, buf=buf@entry=0x7f57d48b51a0 <VMError::report(outputStream*)::buf> "/lib64/libc.so.6", buflen=buflen@entry=2000,
    pc=0x7f57d493d1a8 <_int_malloc+3736> "L;h(uWI\213U(L;j uMI\203|$ ") at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/runtime/frame.cpp:689
#12 0x00007f57d3e4cd00 in frame::print_on_error (this=this@entry=0x7f57a6e71f90, st=st@entry=0x7f57a6e72610, buf=buf@entry=0x7f57d48b51a0 <VMError::report(outputStream*)::buf> "/lib64/libc.so.6",
    buflen=buflen@entry=2000, verbose=verbose@entry=false) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/runtime/frame.cpp:755
#13 0x00007f57d4396462 in VMError::report (this=0x7f57a6e72710, st=st@entry=0x7f57a6e72610)
    at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/utilities/vmError.cpp:509
#14 0x00007f57d43980ff in VMError::report_and_die (this=this@entry=0x7f57a6e72710) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/utilities/vmError.cpp:987
#15 0x00007f57d4197b75 in JVM_handle_linux_signal (sig=11, info=0x7f57a6e729b0, ucVoid=0x7f57a6e72880, abort_if_unrecognized=<optimized out>)
    at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/os_cpu/linux_x86/vm/os_linux_x86.cpp:541
#16 0x00007f57d418ace8 in signalHandler (sig=11, info=0x7f57a6e729b0, uc=0x7f57a6e72880) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/os/linux/vm/os_linux.cpp:4556
#17 <signal handler called>
#18 _int_malloc (av=av@entry=0x7f57d4c81760 <main_arena>, bytes=bytes@entry=17408) at malloc.c:3611
#19 0x00007f57d493fb1c in __GI___libc_malloc (bytes=17408) at malloc.c:2905
#20 0x00007f57d418459d in malloc (stack=..., memflags=mtInternal, size=17408) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/runtime/os.cpp:637
#21 os::malloc (size=size@entry=17408, flags=flags@entry=mtInternal) at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/runtime/os.cpp:589
#22 0x00007f57d4362162 in Unsafe_AllocateMemory (env=<optimized out>, unsafe=<optimized out>, size=17408)
    at /usr/src/debug/java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64/openjdk/hotspot/src/share/vm/prims/unsafe.cpp:626
#23 0x00007f57c5106d38 in ?? ()
#24 0x00000006c0a19228 in ?? ()
#25 0x0000000794750ef8 in ?? ()
#26 0x00000006c15d8158 in ?? ()
#27 0xf28ea1dffffffffe in ?? ()
#28 0x0000000000000000 in ?? ()