Camel SFTP - Running multiple SFTP consumers in clustered environment

Posted on

Our requirement is to run multiple instances of SFTP consumers listening to the SFTP folder. The issue is sometimes both consumer picks up the same file which is causing duplicate data.

Upon exploring options, JDBC idempotent repository approach could solve our problem but it requires JDBC configuration repeated in all the applications. We have more than 50 micro apps following the same pattern and which requires additional config replicated in all apps.

Is there a better way to handle/solve the sftp clustering issue in Apache Camel running on SpringBoot/Openshift ?

VM

Responses