Results 1 to 2 of 2

Thread: JDBCCursorItemReader - Multithreading

  1. Apr 28th, 2009, 03:34 PM #1
    amirvenkat
    amirvenkat is offline Member
    Join Date
    Jan 2009
    Posts
    37

    Default JDBCCursorItemReader - Multithreading

    Hi,

    We have table of 100,000 records or so and Id column is primary key.
    And we decided to use multithreading using taskExecutor. The question
    that the team has is:

    Assuming we read the primary keys first and put them in an iterator.

    1. Can we use JDBCCursorItemReader for this requirement and is
    Multithreading possible in this case.

    2. Or can we stick with the sample 'ParallelJob' approach - Just use
    ItemReader class & leverage taskExecutor.

    3. Suggest the one that could give us best performance.

    --venkat
    Reply With Quote Reply With Quote
  2. Apr 28th, 2009, 10:10 PM #2
    msharma21
    msharma21 is offline Junior Member
    Join Date
    Apr 2009
    Posts
    2

    Default JDBCCursorItemReader - Multithreading

    We had a similar issue where we were supposed to read around 2.5 million records from a table. The process we have developed did not require multi threading and was able to handle 2.5 million records easily on a system with 2 GB RAM.100K records can be handled easily by JVM for processing. The hardware configuration matters as well.It should be fine with you as long as you have a 2GB machine.
    Reply With Quote Reply With Quote
« Previous Thread | Next Thread »

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules