"org.jboss.cache.lock.TimeoutException: Timed out waiting for flush to unblock" in JBoss EAP log

Solution Verified - Updated -

Issue

  • When one EAP instance stops responding to requests, due to non-stop Full Garbage Collection (GC) activity and OutOfMemoryErrors (OOME), the following WARN messages appear in the logs of the other node continuously.
    WARN  [org.jboss.web.tomcat.service.session.InstantSnapshotManager./myapp] (http-xxx-1) Failed to replicate session ABCDEFGHIJKLMNOPQRSTUV__.node1
    java.lang.RuntimeException: Continued to catch TimeoutException during 3 retry attempts. Giving up.
     at org.jboss.web.tomcat.service.session.distributedcache.impl.jbc.JBossCacheWrapper.put(JBossCacheWrapper.java:175)
     at org.jboss.web.tomcat.service.session.distributedcache.impl.jbc.AbstractJBossCacheService.storeSessionData(AbstractJBossCacheService.java:409)
     at org.jboss.web.tomcat.service.session.ClusteredSession.processSessionReplication(ClusteredSession.java:1192)
     at org.jboss.web.tomcat.service.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:2182)
     at org.jboss.web.tomcat.service.session.JBossCacheManager.storeSession(JBossCacheManager.java:313)
     at org.jboss.web.tomcat.service.session.InstantSnapshotManager.snapshot(InstantSnapshotManager.java:51)
    ...
     at java.lang.Thread.run(Thread.java:736)
    Caused by: 
    org.jboss.cache.lock.TimeoutException: Timed out waiting for flush to unblock. (timeout = 60 seconds)
     at org.jboss.cache.RPCManagerImpl$FlushTracker.waitForFlushCompletion(RPCManagerImpl.java:195)
     at org.jboss.cache.RPCManagerImpl.callRemoteMethods(RPCManagerImpl.java:741)
    ...
     at org.jboss.web.tomcat.service.session.distributedcache.impl.jbc.JBossCacheWrapper.put(JBossCacheWrapper.java:162)
     ... 24 more
    
  • Why does the EAP instance which does not have memory problems stop responding to client requests even though it does not suffer from the same OOME as the other node in the cluster?

Environment

  • Red Hat JBoss Enterprise Application Platform (EAP)  
    • 5.x

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content