"org.jboss.cache.lock.TimeoutException: Timed out waiting for flush to unblock" in JBoss EAP log

Solution Verified - Updated -

Issue

  • When one EAP instance stops responding to requests, due to non-stop Full Garbage Collection (GC) activity and OutOfMemoryErrors (OOME), the following WARN messages appear in the logs of the other node continuously.
    WARN  [org.jboss.web.tomcat.service.session.InstantSnapshotManager./myapp] (http-xxx-1) Failed to replicate session ABCDEFGHIJKLMNOPQRSTUV__.node1
    java.lang.RuntimeException: Continued to catch TimeoutException during 3 retry attempts. Giving up.
     at org.jboss.web.tomcat.service.session.distributedcache.impl.jbc.JBossCacheWrapper.put(JBossCacheWrapper.java:175)
     at org.jboss.web.tomcat.service.session.distributedcache.impl.jbc.AbstractJBossCacheService.storeSessionData(AbstractJBossCacheService.java:409)
     at org.jboss.web.tomcat.service.session.ClusteredSession.processSessionReplication(ClusteredSession.java:1192)
     at org.jboss.web.tomcat.service.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:2182)
     at org.jboss.web.tomcat.service.session.JBossCacheManager.storeSession(JBossCacheManager.java:313)
     at org.jboss.web.tomcat.service.session.InstantSnapshotManager.snapshot(InstantSnapshotManager.java:51)
    ...
     at java.lang.Thread.run(Thread.java:736)
    Caused by: 
    org.jboss.cache.lock.TimeoutException: Timed out waiting for flush to unblock. (timeout = 60 seconds)
     at org.jboss.cache.RPCManagerImpl$FlushTracker.waitForFlushCompletion(RPCManagerImpl.java:195)
     at org.jboss.cache.RPCManagerImpl.callRemoteMethods(RPCManagerImpl.java:741)
    ...
     at org.jboss.web.tomcat.service.session.distributedcache.impl.jbc.JBossCacheWrapper.put(JBossCacheWrapper.java:162)
     ... 24 more
    
  • Why does the EAP instance which does not have memory problems stop responding to client requests even though it does not suffer from the same OOME as the other node in the cluster?

Environment

  • Red Hat JBoss Enterprise Application Platform (EAP)  
    • 5.x

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In