Apr 1st, 2010, 09:22 PM
Spring Batch Remote Chunking and Parallel Processing example
Are there any Spring Batch code samples available on the web that show how to perform remote chunking or parallel processing using JMS or RMI? I am working on a POC and looking for an easy way to implement remote chunking since our data can be split into chunks easily. I can see huge benefits to being able to push work out to remote nodes within our Weblogic environment.
Apr 2nd, 2010, 01:44 AM
Have a look to the "spring-batch-integration" module in the "spring-batch-admin" project. It defines various use cases like remote chunking using Spring integration.
I have posted a spring integration config sample for a JMS-based message gateway. You could use that in your Weblogic env with a clustered queuing system.
See http://forum.springsource.org/showthread.php?t=82102 (last post) and http://forum.springsource.org/showthread.php?t=82015
Apr 2nd, 2010, 07:22 AM
Thanks. We will try this and respond if we get it working.
Apr 6th, 2010, 06:11 AM
I'm actually implementing remote chunking using GridGain, I gonna share my code on git when done... I used spring-batch-integration as basis, but I'm surprised to see it inside the spring-batch-admin project...
Originally Posted by thowell
Apr 6th, 2010, 07:10 AM
ditto. I believe the rationale behind it is to clearly separate the integration project from Spring Batch itself since it relies on another portfolio module (spring integration).
Originally Posted by alois.cochard