JON agent crashes with 32-bit JVM on 64-bit AIX

Solution Unverified - Updated -

Issue

  • The Agent is able to register to the server, but after a while it starts a core dump after an unhandled exception. It generates a backtrace like the following
    • Current thread
      ----------------------
          "InventoryManager.discovery-1" J9VMThread:0x32985600, j9thread_t:0x325BF9DC, java/lang/Thread:0xE2D74C68, state:R, prio=5
                 (native thread ID:0x5620E9, native priority:0x5, native policy:UNKNOWN)
                Java callstack:
                    at org/hyperic/sigar/ProcFd.gather(Native Method)
                    at org/hyperic/sigar/ProcFd.fetch(ProcFd.java:30)
                    at org/hyperic/sigar/Sigar.getProcFd(Sigar.java:531)
                    at sun/reflect/NativeMethodAccessorImpl.invoke0(Native Method)
                    at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:48(Compiled Code))
                    at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37(Compiled Code))
                    at java/lang/reflect/Method.invoke(Method.java:578(Compiled Code))
                    at org/rhq/core/system/SigarAccess$SigarAccessHandler.invoke(SigarAccess.java:104)
                    at $Proxy33.getProcFd(Bytecode PC:21)
                    at org/rhq/core/system/ProcessInfo.update(ProcessInfo.java:166)
                    at org/rhq/core/system/ProcessInfo.<init>(ProcessInfo.java:91)
                    at org/rhq/core/system/NativeSystemInfo.getAllProcesses(NativeSystemInfo.java:227)
                    at org/rhq/core/pc/inventory/AutoDiscoveryExecutor.getProcessInfos(AutoDiscoveryExecutor.java:137)
                    at org/rhq/core/pc/inventory/AutoDiscoveryExecutor.call(AutoDiscoveryExecutor.java:103)
                    at org/rhq/core/pc/inventory/AutoDiscoveryExecutor.run(AutoDiscoveryExecutor.java:92)
                    at java/util/concurrent/Executors$RunnableAdapter.call(Executors.java:453)
                    at java/util/concurrent/FutureTask$Sync.innerRunAndReset(FutureTask.java:329)
                    at java/util/concurrent/FutureTask.runAndReset(FutureTask.java:162)
                    at java/util/concurrent/ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
                    at java/util/concurrent/ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:181)
                    at java/util/concurrent/ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:205)
                    at java/util/concurrent/ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
                    at java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
                    at java/lang/Thread.run(Thread.java:736)
                Native callstack:
                    Java_org_hyperic_sigar_ProcFd_gather+0x98 (0xD6FA8D3C [libsigar-ppc-aix-5.so+0x1cd3c])
                    (0xD541E748 [libj9vm24.so+0x48748])
                    (0xD53B8394 [libjvm.so+0x9394])
                    Java_sun_reflect_NativeMethodAccessorImpl_invoke0+0x18 (0xD54BD934 [libjava.so+0x16934])
                    (0x3065026C)
                    (0xD53E2C9C [libj9vm24.so+0xcc9c])
                    (0xD546BA18 [libj9prt24.so+0x3a18])
                    (0xD53E2BB8 [libj9vm24.so+0xcbb8])
                    (0xD54577CC [libj9thr24.so+0x27cc])
                    _pthread_body+0x118 (0xD010D784 [libpthreads.a+0x3784])
      
  • Agent crashes and produces core dump
  • Agent starts for a short period of time and then crashes with the last few log entries:
    • INFO [main] (rhq.core.pc.inventory.InventoryManager)- Initializing Inventory Manager...
      INFO [main] (rhq.core.pc.inventory.InventoryManager)- Loading inventory from data file [data/inventory.dat]...
      INFO [main] (rhq.core.pc.inventory.InventoryManager)- Inventory with size [13] initialized from data file in [2738ms]
      INFO [main] (rhq.core.pc.inventory.InventoryManager)- Inventory Manager initialized.
      INFO [main] (rhq.core.pc.inventory.ResourceFactoryManager)- Initializing
      INFO [main] (rhq.core.pc.content.ContentManager)- Initializing Content Manager...
      INFO [main] (rhq.core.pc.content.ContentManager)- Initializing scheduled content discovery...
      INFO [main] (rhq.core.pc.content.ContentManager)- Content Manager initialized...
      INFO [main] (org.rhq.core.pc.PluginContainer)- Plugin Container initialized.
      INFO [RHQ Primary Server Switchover Thread] (org.rhq.enterprise.agent.AgentMain)- {PrimaryServerSwitchoverThread.started}The primary server switchover thread has started.
      INFO [InventoryManager.discovery-1] (rhq.core.pc.inventory.AutoDiscoveryExecutor)- Executing server discovery scan...
      

Environment

  • JBoss Operations Network (JON)

    • 2.4.x
    • 3.0.x
    • 3.1.x
  • IBM AIX 64-bit 5.2, 5.3

  • IBM j9 32-bit Java Virtual Machine (JVM)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content