BRMS boot gets stuck in cluster environment

Solution Unverified - Updated -

Issue

  • We have setup zookeeper/helix to accomplish GIT replication. With the first try of the setup everything works fine but after couple days the BRMS JVMs wont respond and won't restart.
[Server:server-one] 12:21:21,581 INFO  [org.apache.helix.manager.zk.CallbackHandler] (ZkClient-EventThread-187-localhost:2181) nodeOne_12345 subscribes child-change. path: /brms-cluster/INSTANCES/nodeOne_12345/MESSAGES, listener: org.apache.helix.messaging.handling.HelixTaskExecutor@2e37ec81
[Server:server-one] 12:21:21,586 INFO  [org.apache.helix.messaging.handling.HelixTaskExecutor] (ZkClient-EventThread-187-localhost:2181) No Messages to process
[Server:server-one] 12:21:21,586 INFO  [org.apache.helix.manager.zk.CallbackHandler] (ZkClient-EventThread-187-localhost:2181) 187 END:INVOKE /brms-cluster/INSTANCES/nodeOne_12345/MESSAGES listener:org.apache.helix.messaging.handling.HelixTaskExecutor Took: 6ms
[Server:server-one] 12:25:39,098 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) JBAS013412: Timeout after [300] seconds waiting for service container stability. Operation will roll back. Step that first updated the service container was 'add' at address '[("interface" => "management")]'
[Server:server-two] 12:25:41,901 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) JBAS013412: Timeout after [300] seconds waiting for service container stability. Operation will roll back. Step that first updated the service container was 'add' at address '[("interface" => "management")]'
[Server:server-one] 12:25:44,102 ERROR [org.jboss.as.controller.client] (Controller Boot Thread) JBAS014781: Step handler org.jboss.as.server.DeployerChainAddHandler$FinalRuntimeStepHandler@308a8dcc for operation {"operation" => "add-deployer-chains","address" => []} at address [] failed handling operation rollback -- java.util.concurrent.TimeoutException

Environment

  • Red Hat JBoss BRMS
    • 6.1.0
    • Clustered with ZooKeeper/Helix

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.