I have a graph algorithm that I need to run a mapreduce job iteratively. Each time, setting the output path to the input path of the next iteration. Currently, I can run iteratively using org.apache.hadoop.mapreduce.Job, and org.apache.hadoop.util.ToolRunner and running from commandline.
How can I do this with Spring Hadoop?
I found I can chain different mapreduce jobs using Spring Batch. But I don't know how to iterate through the same mapreduce job using Spring Hadoop/Batch? (each time setting the output path to the input path of the next iteration)
Any suggestions and references will be greatly appreciated.