Multithreaded and Non database oriented

[anish555]

Hi
I have been working on Spring batch from last 2 years.

In my current project I have different requirement to use multithreaded approach of Spring batch.
Process need to read records from a 200GB file and proces records and write records to different files based on the criteria in which they fall under.

One more thing is we do not need to access database. So can I use InMemoryRepository and AsynchronousTaskExecutor?

Can someone suggest me the best approach for dealing with this requirement.

[Marten Deinum]

It depends.. Do you want to store the state of your job, if your job fails do oyou want to know why and where it stopped. If that is the case you also need a database, if you use the InMemoryRepository that information is all lost...

[Dave Syer]

The MapJobRepositoryFactoryBean is allegedly thread safe from Batch 2.1, but in production I would use an in-memory relational database (H2 is probably the most robust).