Red Hat Fuse - Quartz Scheduler - ARJUNA TransactionReaper:check timeout from Oracle DB

Issue

• We have a quartz scheduler and during processing where it goes to fetch the records from oracle database. It somehow gives the below error:

2021-07-20 17:23:54,042 | WARN  | Transaction Reaper   | c.a.a.arjuna                     | 6 - org.ops4j.pax.logging.pax-logging-api - 1.11.6 | ARJUNA012117: TransactionReaper::check timeout for TX 0:ffff0a061e16:f647:60f6b81f:c6 in state  RUN
2021-07-20 17:23:54,044 | WARN  | tion Reaper Worker 0 | c.a.a.arjuna                     | 6 - org.ops4j.pax.logging.pax-logging-api - 1.11.6 | ARJUNA012095: Abort of action id 0:ffff0a061e16:f647:60f6b81f:c6 invoked while multiple threads active within it.
2021-07-20 17:23:54,047 | WARN  | tion Reaper Worker 0 | c.a.a.arjuna                     | 6 - org.ops4j.pax.logging.pax-logging-api - 1.11.6 | ARJUNA012381: Action id 0:ffff0a061e16:f647:60f6b81f:c6 completed with multiple threads - thread MyDataPipeline
                -My_Worker-1 was in progress with java.net.SocketInputStream.socketRead0(Native Method)
java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
java.net.SocketInputStream.read(SocketInputStream.java:171)
java.net.SocketInputStream.read(SocketInputStream.java:141)
oracle.net.ns.Packet.receive(Packet.java:282)
oracle.net.ns.DataPacket.receive(DataPacket.java:103)
oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:230)
oracle.net.ns.NetInputStream.read(NetInputStream.java:175)
oracle.net.ns.NetInputStream.read(NetInputStream.java:100)
oracle.net.ns.NetInputStream.read(NetInputStream.java:85)
oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:122)
oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:78)
oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1179)
oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1155)
oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:279)
oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:186)
oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:521)
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:205)
oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1082)
oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:369)
oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:273)
org.apache.commons.dbcp2.DelegatingResultSet.next(DelegatingResultSet.java:1160)
org.apache.commons.dbcp2.DelegatingResultSet.next(DelegatingResultSet.java:1160)
org.hibernate.loader.Loader.processResultSet(Loader.java:998)
org.hibernate.loader.Loader.doQuery(Loader.java:960)
org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:351)
org.hibernate.loader.Loader.doList(Loader.java:2787)
org.hibernate.loader.Loader.doList(Loader.java:2770)
org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2604)
org.hibernate.loader.Loader.list(Loader.java:2599)
org.hibernate.loader.custom.CustomLoader.list(CustomLoader.java:338)
org.hibernate.internal.SessionImpl.listCustomQuery(SessionImpl.java:2243)
org.hibernate.internal.AbstractSharedSessionContract.list(AbstractSharedSessionContract.java:1069)
org.hibernate.query.internal.NativeQueryImpl.doList(NativeQueryImpl.java:170)
org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1506)
org.hibernate.query.Query.getResultList(Query.java:132)
com.mypackage.getSomeMethod(SomeImpl.java:63)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
org.apache.aries.proxy.impl.ProxyHandler$1.invoke(ProxyHandler.java:54)
org.apache.aries.proxy.impl.ProxyHandler.invoke(ProxyHandler.java:119)
com.sun.proxy.$Proxy118.getBrokerCodesForNetworkAccount(Unknown Source)
org.apache.camel.processor.DelegateSyncProcessor.process(DelegateSyncProcessor.java:63)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.Pipeline.process(Pipeline.java:138)
org.apache.camel.processor.Pipeline.process(Pipeline.java:101)
org.apache.camel.processor.ChoiceProcessor.process(ChoiceProcessor.java:117)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.Pipeline.process(Pipeline.java:138)
org.apache.camel.processor.Pipeline.process(Pipeline.java:101)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.component.direct.DirectProducer.process(DirectProducer.java:76)
org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.ChoiceProcessor.process(ChoiceProcessor.java:117)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.Pipeline.process(Pipeline.java:138)
org.apache.camel.processor.Pipeline.process(Pipeline.java:101)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.component.direct.DirectProducer.process(DirectProducer.java:76)
org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.Pipeline.process(Pipeline.java:138)
org.apache.camel.processor.Pipeline.process(Pipeline.java:101)
org.apache.camel.processor.ChoiceProcessor.process(ChoiceProcessor.java:117)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.Pipeline.process(Pipeline.java:138)
org.apache.camel.processor.Pipeline.process(Pipeline.java:101)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.component.direct.DirectProducer.process(DirectProducer.java:76)
org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.ChoiceProcessor.process(ChoiceProcessor.java:117)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.Pipeline.process(Pipeline.java:138)
org.apache.camel.processor.Pipeline.process(Pipeline.java:101)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.component.direct.DirectProducer.process(DirectProducer.java:76)
org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.Pipeline.process(Pipeline.java:138)
org.apache.camel.processor.Pipeline.process(Pipeline.java:101)
org.apache.camel.processor.ChoiceProcessor.process(ChoiceProcessor.java:117)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.Pipeline.process(Pipeline.java:138)
org.apache.camel.processor.Pipeline.process(Pipeline.java:101)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.component.direct.DirectProducer.process(DirectProducer.java:76)
org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148)
org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:548)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
org.apache.camel.processor.loadbalancer.QueueLoadBalancer.process(QueueLoadBalancer.java:44)
org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:109)
org.apache.camel.processor.loadbalancer.LoadBalancerSupport.process(LoadBalancerSupport.java:97)
org.apache.camel.component.quartz2.CamelJob.execute(CamelJob.java:58)
org.quartz.core.JobRunShell.run(JobRunShell.java:202)
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)

2021-07-20 17:23:54,047 | WARN  | tion Reaper Worker 0 | c.a.a.arjuna                     | 6 - org.ops4j.pax.logging.pax-logging-api - 1.11.6 | ARJUNA012108: CheckedAction::check - atomic action 0:ffff0a061e16:f647:60f6b81f:c6 aborting with 1 threads active!
2021-07-20 17:23:54,049 | WARN  | tion Reaper Worker 0 | nCallbackCoordinatorTrackingImpl | 291 - org.hibernate.orm.core - 5.3.17.Final-redhat-00001 | HHH000451: Transaction afterCompletion called by a background thread; delaying afterCompletion processing until the original thread can handle it. [status=4]
2021-07-20 17:23:54,049 | WARN  | tion Reaper Worker 0 | c.a.a.arjuna                     | 6 - org.ops4j.pax.logging.pax-logging-api - 1.11.6 | ARJUNA012121: TransactionReaper::doCancellations worker Thread[Transaction Reaper Worker 0,5,main] successfully canceled TX 0:ffff0a061e16:f647:60f6b81f:c6
2021-07-20 17:25:00,008 | INFO  | ionPipeline_Worker-2 | o.a.c.c.q.QuartzComponent        | 314 - org.apache.camel.camel-quartz2 - 2.17.0.redhat-630262 | The scheduler has already been started.
2021-07-20 17:25:00,008 | INFO  | ionPipeline_Worker-2 | o.a.c.b.BlueprintCamelContext    | 64 - org.apache.camel.camel-core - 2.23.2.fuse-780036-redhat-00001 | Route: imrFailureQueueRoute started and consuming from: amq://some.queue?concurrentConsumers=1&maxConcurrentConsumers=1
2021-07-20 17:30:00,001 | INFO  | ionPipeline_Worker-3 | o.a.c.c.q.QuartzComponent        | 314 - org.apache.camel.camel-quartz2 - 2.17.0.redhat-630262 | The scheduler has already been started.

• I am attaching the complete fuse logs as well and the code snapshot for database handling as well below:

              lEntityManager = getSomeDao().getEntityManagerFactory().createEntityManager();
              transaction  = lEntityManager.getTransaction(); 
              transaction.begin();
              Query query = lEntityManager.createNativeQuery(SOME_CONSTANT);
              query.setParameter(1, Code);
              query.setParameter(2,Type);
              List<Object[]> obj = query.getResultList();
                if (CollectionUtils.isNotEmpty(obj) && obj.size()>0) {