
Originally Posted by
Diego Bravo
I had the same problem but not in a SI scenario. A large text file that is transmitted to us via internet daily with scp (openssh server in our side.) The line is slow so there is a big chance of catching a partial file. The file loader loader just compares the file write time with the current time, and awaits for a difference of 120 secs or more; else, the file is ignored for some time and the pooling restarts. The rationale is that a temporary line interruption should not be so large and that every file chunk received and saved is updating the file time automatically. It would be nice to have a similar functionality in the file components of SI.