Hi guys,

I want to pull large files from a remote FTP site but I want to process these files using Batch as they are being pulled to maximise efficiency. Is there an FTP Item Reader example anywhere that I can use, or is this even possible? I know there's no out-of-the-box solution.

Basically, I'll have a poller checking for new files in the remote ftp dir. When it finds one, it will kick off a batch job (using FileToJobLaunchRequestAdapter) which will start to pull the file. Let's say if the file is 1GB, the job should break it into 10 files of 100MB each, which would allow other steps to work on these smaller files while the large file is still in transit. Does that make sense?

Cheers for any tips or help,
Tony