BRMS boot gets stuck in cluster environment
Issue
- We have setup zookeeper/helix to accomplish GIT replication. With the first try of the setup everything works fine but after couple days the BRMS JVMs wont respond and won't restart.
[Server:server-one] 12:21:21,581 INFO [org.apache.helix.manager.zk.CallbackHandler] (ZkClient-EventThread-187-localhost:2181) nodeOne_12345 subscribes child-change. path: /brms-cluster/INSTANCES/nodeOne_12345/MESSAGES, listener: org.apache.helix.messaging.handling.HelixTaskExecutor@2e37ec81
[Server:server-one] 12:21:21,586 INFO [org.apache.helix.messaging.handling.HelixTaskExecutor] (ZkClient-EventThread-187-localhost:2181) No Messages to process
[Server:server-one] 12:21:21,586 INFO [org.apache.helix.manager.zk.CallbackHandler] (ZkClient-EventThread-187-localhost:2181) 187 END:INVOKE /brms-cluster/INSTANCES/nodeOne_12345/MESSAGES listener:org.apache.helix.messaging.handling.HelixTaskExecutor Took: 6ms
[Server:server-one] 12:25:39,098 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) JBAS013412: Timeout after [300] seconds waiting for service container stability. Operation will roll back. Step that first updated the service container was 'add' at address '[("interface" => "management")]'
[Server:server-two] 12:25:41,901 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) JBAS013412: Timeout after [300] seconds waiting for service container stability. Operation will roll back. Step that first updated the service container was 'add' at address '[("interface" => "management")]'
[Server:server-one] 12:25:44,102 ERROR [org.jboss.as.controller.client] (Controller Boot Thread) JBAS014781: Step handler org.jboss.as.server.DeployerChainAddHandler$FinalRuntimeStepHandler@308a8dcc for operation {"operation" => "add-deployer-chains","address" => []} at address [] failed handling operation rollback -- java.util.concurrent.TimeoutException
Environment
- Red Hat JBoss BRMS
- 6.1.0
- Clustered with ZooKeeper/Helix
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.