Multi-threaded (partitioned step) batch summary processing advice needed
I've been reading over some of the Spring Batch related documentation and have a couple of questions regarding a job flow. Take the following as truth:
A batch job where 100,000 database records are to be processed and written into files containing at most 2,000 records. After all records have been exported, all record files must then be encrypted and a "summary" file must be generated containing the new filenames along with record counts for each.
The batch job will contain a partitioned step (for multiple remote execution scalability) that creates the output file(s) with the processed records.
Given that quick description, what is the best route to handle it? Should a Tasklet be used to handle encryption and the "summary" file? It almost sounds as if I should add the filenames/record counts for the generated output files to the execution context and use that. Is there another (preferably better) approach?
"The Guide says that there is an art to flying," said Ford, "or rather a knack. The knack lies in learning how to throw yourself at the ground and miss."