Dynamic Step Creation

[katz_jd]

Our application has multiple steps running in parallel each of which has a reader that polls a given (injected) ArrayBlockingQueue. A requirement is to allow a user to increase the number of one or more of the steps so that more than one reader is polling a given queue.

Is it possible to dynamically (programmatically) create a step running in parallel with other steps within a given job?

[Jul]

Sorry, I'm not fully understood waht you mean.

Do you want to create a step dinamically (with different logic) or you mean to increase number of threads for already defined step?

[katz_jd]

Sorry, I'm not fully understood waht you mean.

Do you want to create a step dinamically (with different logic) or you mean to increase number of threads for already defined step?

I've solved this problem using partitioning. By increasing the grid size we're able to increase the number of steps running simultaneously. The grid size is set via a properties file entry.