Feb 15th, 2011, 04:23 PM
Database Polling -- One message per row
According to http://static.springsource.org/sprin...hannel-adapter, all rows available to a query are retrieved at once, and then submitted in once batch for future processing. In addition, if any updates to the DB need to occur, they are executed before downstream processing commences.
Q: Is there a way to process one row at a time, as I am aware of scenarios at multiple locations where the returned datasets can readily run into a minimum 10K (for one site) or 10M (for another site). I am concerned about timeouts, Out of Memory Errors, etc.
Q: Is there a way to update one row at a time AFTER the downstream processing has completed? Error conditions may occur during processing, such as network outages, third party system outages, etc., that would force a retry of the unfinished processing later (finished processing do not need to be retried, and a retry may actually cause erroneous duplicate updates to external systems, as well as unneeded traffic).
Tags for this Thread