Thanks Lucas. Which ItemWriter should i use to write the records? A Simple JdbcItemWriter which uses JdbcTemplate to insert the records into the staging table? Is that enough?
thanks,
Ramkris
Printable View
Thanks Lucas. Which ItemWriter should i use to write the records? A Simple JdbcItemWriter which uses JdbcTemplate to insert the records into the staging table? Is that enough?
thanks,
Ramkris
I would try that at first since it's the simplest solution. If you have access to the SimpleJdbcInsert that was added in 2.5, you can use that for a configuration only option that's quite nice as well. I would also make sure the step loading your data into the database is the SkipLimitStepFactoryBean, so that you can set a skip limit for any parsing errors you get while reading in from the file. Hopefully, if your data is fairly clean of write failures (which is should be on a simple insert) then you should be able to use a fairly high commit interval.