Spring Batch Remote Chunking and Parallel Processing example

[thowell]

Are there any Spring Batch code samples available on the web that show how to perform remote chunking or parallel processing using JMS or RMI? I am working on a POC and looking for an easy way to implement remote chunking since our data can be split into chunks easily. I can see huge benefits to being able to push work out to remote nodes within our Weblogic environment.

[snicoll]

Yup,

Have a look to the "spring-batch-integration" module in the "spring-batch-admin" project. It defines various use cases like remote chunking using Spring integration.

I have posted a spring integration config sample for a JMS-based message gateway. You could use that in your Weblogic env with a clustered queuing system.

See http://forum.springsource.org/showthread.php?t=82102 (last post) and http://forum.springsource.org/showthread.php?t=82015

HTH,
S.

[thowell]

Thanks. We will try this and respond if we get it working.

[alois.cochard]

Thanks. We will try this and respond if we get it working.

I'm actually implementing remote chunking using GridGain, I gonna share my code on git when done... I used spring-batch-integration as basis, but I'm surprised to see it inside the spring-batch-admin project...

Alois Cochard
http://aloiscochard.blogspot.com
http://www.twitter.com/aloiscochard

[snicoll]

I used spring-batch-integration as basis, but I'm surprised to see it inside the spring-batch-admin project...

ditto. I believe the rationale behind it is to clearly separate the integration project from Spring Batch itself since it relies on another portfolio module (spring integration).