Issue

• Yesterday lunchtime, our server Amq, suddenly died, can restart come up; Kahab db file is not big. We have applied a special patch already, looks like still have this problem from older case.
• Error observed

018-09-13 13:05:30,939 | INFO  | AMQ-1-thread-1   | MessageDatabase                  | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | @4218:32714830, 1100000 entries recovered ..
2018-09-13 13:05:32,248 | INFO  | AMQ-1-thread-1   | MessageDatabase                  | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | @4388:21025476, 1200000 entries recovered ..
2018-09-13 13:05:33,501 | INFO  | AMQ-1-thread-1   | MessageDatabase                  | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | @4390:8945414, 1300000 entries recovered ..
2018-09-13 13:05:34,710 | INFO  | AMQ-1-thread-1   | MessageDatabase                  | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | @4400:32200089, 1400000 entries recovered ..
2018-09-13 13:05:34,739 | ERROR | AMQ-1-thread-1   | BrokerService                    | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Failed to start Apache ActiveMQ ([ABCGroup2_broker, null], java.io.EOFException)
2018-09-13 13:05:34,739 | INFO  | AMQ-1-thread-1   | BrokerService                    | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Apache ActiveMQ 5.11.0.redhat-621216 (ABCGroup2_broker, null) is shutting down
2018-09-13 13:05:34,746 | INFO  | AMQ-1-thread-1   | NetworkConnector                 | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Network Connector DiscoveryNetworkConnector:fabric-ABCGroup1:BrokerService[ABCGroup2_broker] stopped
2018-09-13 13:05:34,746 | INFO  | AMQ-1-thread-1   | NetworkConnector                 | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Network Connector DiscoveryNetworkConnector:fabric-ABCGroup3:BrokerService[ABCGroup2_broker] stopped
2018-09-13 13:05:34,752 | INFO  | AMQ-1-thread-1   | TransportConnector               | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Connector openwire stopped
2018-09-13 13:05:34,752 | INFO  | AMQ-1-thread-1   | TransportConnector               | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Connector mqtt stopped
2018-09-13 13:05:34,752 | INFO  | AMQ-1-thread-1   | JobSchedulerStoreImpl            | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | JobSchedulerStore: /home/appadmin/server/jboss-fuse-6.2.1.redhat-107/instances/fuseapp2_amqbroker1/ABCGroup2_broker/ABCGroup2_broker/scheduler stopped.
2018-09-13 13:05:34,752 | INFO  | AMQ-1-thread-1   | PListStoreImpl                   | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | PListStore:[/home/appadmin/server/jboss-fuse-6.2.1.redhat-107/instances/fuseapp2_amqbroker1/ABCGroup2_broker/ABCGroup2_broker/tmp_storage] stopped
2018-09-13 13:05:34,752 | INFO  | AMQ-1-thread-1   | KahaDBStore                      | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Stopping async queue tasks
2018-09-13 13:05:34,752 | INFO  | AMQ-1-thread-1   | KahaDBStore                      | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Stopping async topic tasks
2018-09-13 13:05:34,752 | INFO  | AMQ-1-thread-1   | KahaDBStore                      | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Stopped KahaDB
2018-09-13 13:05:35,299 | INFO  | AMQ-1-thread-1   | BrokerService                    | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Apache ActiveMQ 5.11.0.redhat-621216 (ABCGroup2_broker, null) uptime 19.300 seconds
2018-09-13 13:05:35,299 | INFO  | AMQ-1-thread-1   | BrokerService                    | 111 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-621216 | Apache ActiveMQ 5.11.0.redhat-621216 (ABCGroup2_broker, null) is shutdown
2018-09-13 13:05:35,299 | INFO  | AMQ-1-thread-1   | ActiveMQServiceFactory           | 100 - io.fabric8.mq.mq-fabric - 1.2.0.redhat-621216 | Broker ABCGroup2_broker failed to start.  Will try again in 10 seconds
2018-09-13 13:05:35,299 | ERROR | AMQ-1-thread-1   | ActiveMQServiceFactory           | 100 - io.fabric8.mq.mq-fabric - 1.2.0.redhat-621216 | Exception on start: java.io.EOFException
java.io.EOFException
        at java.io.RandomAccessFile.readInt(RandomAccessFile.java:803)[:1.8.0_65]
        at org.apache.activemq.util.RecoverableRandomAccessFile.readInt(RecoverableRandomAccessFile.java:165)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.store.kahadb.disk.journal.DataFileAccessor.readLocationDetails(DataFileAccessor.java:112)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
 at org.apache.activemq.store.kahadb.disk.journal.Journal.getNextLocation(Journal.java:648)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.store.kahadb.MessageDatabase.recover(MessageDatabase.java:621)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.store.kahadb.MessageDatabase.open(MessageDatabase.java:400)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.store.kahadb.MessageDatabase.load(MessageDatabase.java:418)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.store.kahadb.MessageDatabase.doStart(MessageDatabase.java:262)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.store.kahadb.KahaDBStore.doStart(KahaDBStore.java:205)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.util.ServiceSupport.start(ServiceSupport.java:55)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.store.kahadb.KahaDBPersistenceAdapter.doStart(KahaDBPersistenceAdapter.java:223)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-62
1216]
        at org.apache.activemq.util.ServiceSupport.start(ServiceSupport.java:55)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.broker.BrokerService.doStartPersistenceAdapter(BrokerService.java:658)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.broker.BrokerService.startPersistenceAdapter(BrokerService.java:642)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at org.apache.activemq.broker.BrokerService.start(BrokerService.java:607)[111:org.apache.activemq.activemq-osgi:5.11.0.redhat-621216]
        at io.fabric8.mq.fabric.ActiveMQServiceFactory$ClusteredConfiguration.doStart(ActiveMQServiceFactory.java:509)[100:io.fabric8.mq.mq-fabric:1.2.0.redhat-621216
]
        at io.fabric8.mq.fabric.ActiveMQServiceFactory$ClusteredConfiguration.access$400(ActiveMQServiceFactory.java:321)[100:io.fabric8.mq.mq-fabric:1.2.0.redhat-621
216]
        at io.fabric8.mq.fabric.ActiveMQServiceFactory$ClusteredConfiguration$1.run(ActiveMQServiceFactory.java:452)[100:io.fabric8.mq.mq-fabric:1.2.0.redhat-621216]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)[:1.8.0_65]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)[:1.8.0_65]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)[:1.8.0_65]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)[:1.8.0_65]
        at java.lang.Thread.run(Thread.java:745)[:1.8.0_65]

• Kahadb is configured following way

<persistenceAdapter>
            <kahaDB directory="${data}/kahadb"/>
</persistenceAdapter>