"org.jboss.cache.lock.TimeoutException: Timed out waiting for flush to unblock" in JBoss EAP log
Issue
- When one EAP instance stops responding to requests, due to non-stop Full Garbage Collection (GC) activity and OutOfMemoryErrors (OOME), the following WARN messages appear in the logs of the other node continuously.
WARN [org.jboss.web.tomcat.service.session.InstantSnapshotManager./myapp] (http-xxx-1) Failed to replicate session ABCDEFGHIJKLMNOPQRSTUV__.node1 java.lang.RuntimeException: Continued to catch TimeoutException during 3 retry attempts. Giving up. at org.jboss.web.tomcat.service.session.distributedcache.impl.jbc.JBossCacheWrapper.put(JBossCacheWrapper.java:175) at org.jboss.web.tomcat.service.session.distributedcache.impl.jbc.AbstractJBossCacheService.storeSessionData(AbstractJBossCacheService.java:409) at org.jboss.web.tomcat.service.session.ClusteredSession.processSessionReplication(ClusteredSession.java:1192) at org.jboss.web.tomcat.service.session.JBossCacheManager.processSessionRepl(JBossCacheManager.java:2182) at org.jboss.web.tomcat.service.session.JBossCacheManager.storeSession(JBossCacheManager.java:313) at org.jboss.web.tomcat.service.session.InstantSnapshotManager.snapshot(InstantSnapshotManager.java:51) ... at java.lang.Thread.run(Thread.java:736) Caused by: org.jboss.cache.lock.TimeoutException: Timed out waiting for flush to unblock. (timeout = 60 seconds) at org.jboss.cache.RPCManagerImpl$FlushTracker.waitForFlushCompletion(RPCManagerImpl.java:195) at org.jboss.cache.RPCManagerImpl.callRemoteMethods(RPCManagerImpl.java:741) ... at org.jboss.web.tomcat.service.session.distributedcache.impl.jbc.JBossCacheWrapper.put(JBossCacheWrapper.java:162) ... 24 more
- Why does the EAP instance which does not have memory problems stop responding to client requests even though it does not suffer from the same OOME as the other node in the cluster?
Environment
- Red Hat JBoss Enterprise Application Platform (EAP)
- 5.x
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.