May 12th, 2009, 10:22 AM
MultiThreading within Reader!!!
I am building an Spring Batch application (v2.0.0) to process multiple files(i.e.task) parallely. Each file may have hundreds of lines of records that need to be processed individually. Currently I am able to create threads(Slaves) for each file (i.e. 10 threads for 10 files) by implementing the Partitioner class(partition method) using ThreadPoolTaskExecutor. Creating one Thread per File (i.e. task) seems to a feature of Spring Batch. I have used the partitionJob.xml example from spring batch samples for reference.
But I want to process a individual file with 50 threads. Is there a way to create the additional threads without being dependent on the number of files (or tasks)?
Tags for this Thread