Improving ESB Performance

Issue

• We are currently performing some testing on our programs that use ESBs and have come across a couple of issues:

  • Performance - The ESB throughput even in mult-threaded mode is unacceptably slow.
  • Persisting Messages - Should the server be shut down and restarted the unprocessed messages are lost.

• We setup a basic ESB test creating a single ESB to use the FileProvider, so we could drop a number of text files to be sent to the ESB. We added a single action to the ESB, to simple print out a log statement. The performance of the system was extremely slow.

• We dropped 2000 text files into the FileProvider's input directory, all the messages disappeared and the ESB started processing them at around 10 per second with maxThreads for the ESB set to 1. We checked the MySQL DB that was being used as our message transaction DB and the number of DB connections did not exceed 20 (Max 50). Should the Server be bounced the remaining messages were lost.