BRMS boot gets stuck in cluster environment

Issue

• We have setup zookeeper/helix to accomplish GIT replication. With the first try of the setup everything works fine but after couple days the BRMS JVMs wont respond and won't restart.

[Server:server-one] 12:21:21,581 INFO  [org.apache.helix.manager.zk.CallbackHandler] (ZkClient-EventThread-187-localhost:2181) nodeOne_12345 subscribes child-change. path: /brms-cluster/INSTANCES/nodeOne_12345/MESSAGES, listener: org.apache.helix.messaging.handling.HelixTaskExecutor@2e37ec81
[Server:server-one] 12:21:21,586 INFO  [org.apache.helix.messaging.handling.HelixTaskExecutor] (ZkClient-EventThread-187-localhost:2181) No Messages to process
[Server:server-one] 12:21:21,586 INFO  [org.apache.helix.manager.zk.CallbackHandler] (ZkClient-EventThread-187-localhost:2181) 187 END:INVOKE /brms-cluster/INSTANCES/nodeOne_12345/MESSAGES listener:org.apache.helix.messaging.handling.HelixTaskExecutor Took: 6ms
[Server:server-one] 12:25:39,098 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) JBAS013412: Timeout after [300] seconds waiting for service container stability. Operation will roll back. Step that first updated the service container was 'add' at address '[("interface" => "management")]'
[Server:server-two] 12:25:41,901 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) JBAS013412: Timeout after [300] seconds waiting for service container stability. Operation will roll back. Step that first updated the service container was 'add' at address '[("interface" => "management")]'
[Server:server-one] 12:25:44,102 ERROR [org.jboss.as.controller.client] (Controller Boot Thread) JBAS014781: Step handler org.jboss.as.server.DeployerChainAddHandler$FinalRuntimeStepHandler@308a8dcc for operation {"operation" => "add-deployer-chains","address" => []} at address [] failed handling operation rollback -- java.util.concurrent.TimeoutException