DelimitedLineTokenizer char delimiter

[AnthonyRyan]

Hi,

Is there a variation of DelimitedLineTokenizer or a different implementation of AbstractLineTokenizer that accepts a String (basically multicharacter) delimiter?

We're processing millions of lines of information in which pretty much every character appears at some point, so using a single character just isn't feasible.

Any reccommendations?

Cheers,
Tony

[mminella]

Tony,

The DelimitedLineTokenizer as of 2.2.0 will accept String tokens in place of a single character as a delimiter. If you want to get a preview, grab the latest development SNAPSHOT and give it a try. You can read about it in the Jira issue here: https://jira.springsource.org/browse/BATCH-1869