How to edit ticktime for Fabric environment ?
Issue
- We have a fabric cluster of 3 hosts having 2-3 child containers running on it. 1 set of containers, lets say CC1,CC2 and CC3 are mq brokers. And on remaining of the 3 containers A1, A2 and A3 , web services are running. Till yesterday, everything was working fine. Yesterday, one our server was restarted due to upgrade of RAM.
- After the reboot, all the web services became unresponsive and we started getting different error in fuse.log of root containers. most of them connection related errors.
-
We tried restarting the root servers as well as the child containers, but still nothing is working. container-start and container-stop commands shows that the service is already running or container stopped successfully. But nothing is happening.
-
logs
2016-06-09 16:59:15,885 | INFO | 10.15.0.228:3888 | QuorumCnxManager | 145 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-621084 | Received connection request /10.15.0.252:46028
2016-06-09 16:59:15,886 | WARN | SendWorker:2 | QuorumCnxManager | 145 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-621084 | Interrupted while waiting for message on queue
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)[:1.7.0_79]
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2095)[:1.7.0_79]
at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)[:1.7.0_79]
at org.apache.zookeeper.server.quorum.QuorumCnxManager.pollSendQueue(QuorumCnxManager.java:849)[145:io.fabric8.fabric-zookeeper:1.2.0.redhat-621084]
at org.apache.zookeeper.server.quorum.QuorumCnxManager.access$500(QuorumCnxManager.java:64)[145:io.fabric8.fabric-zookeeper:1.2.0.redhat-621084]
at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:685)[145:io.fabric8.fabric-zookeeper:1.2.0.redhat-621084]
2016-06-09 16:59:15,888 | WARN | RecvWorker:2 | QuorumCnxManager | 145 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-621084 | Connection broken for id 2, my id = 1, error =
java.net.SocketException: Socket closed
at java.net.SocketInputStream.socketRead0(Native Method)[:1.7.0_79]
at java.net.SocketInputStream.read(SocketInputStream.java:152)[:1.7.0_79]
at java.net.SocketInputStream.read(SocketInputStream.java:122)[:1.7.0_79]
at java.net.SocketInputStream.read(SocketInputStream.java:210)[:1.7.0_79]
at java.io.DataInputStream.readInt(DataInputStream.java:387)[:1.7.0_79]
at org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:765)[145:io.fabric8.fabric-zookeeper:1.2.0.redhat-621084]
2016-06-09 16:59:15,888 | WARN | SendWorker:2 | QuorumCnxManager | 145 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-621084 | Send worker leaving thread
2016-06-09 16:59:15,888 | WARN | RecvWorker:2 | QuorumCnxManager | 145 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-621084 | Interrupting SendWorker
2016-06-09 16:59:15,889 | INFO | Receiver[myid=1] | FastLeaderElection | 145 - io.fabric8.fabric-zookeeper - 1.2.0.redhat-621084 | Notification: 1 (message format version), 2 (n.leader), 0x250000022e (n.zxid), 0x25 (n.round), LOOKING (n.state), 2 (n.sid), 0x25 (n.peerEpoch) LEADING (my state)
Environment
- Red Hat JBoss Fuse
- 6.2.1
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.