Results 1 to 3 of 3

Thread: using spring-batch inside mapper

  1. #1

    Default using spring-batch inside mapper

    Hi,
    i discovered new use case which should be covered by hadoop spring extension. Use Spring-Batch framework from Hadoop mapper.

    As i see, currently only scenario supported is to use entire mapreduce job as tasklet.

    My intended use is to use spring-batch for writing multi-threaded mappers using multi-threaded steps.

  2. #2
    Join Date
    Jan 2005
    Location
    Bucharest, Romania
    Posts
    5,403

    Default

    Currently we haven't added anything extra in SHDP for this (not there needs to be). Is there anything in particular that you're looking for or that is not working?

    Cheers,
    Costin Leau
    SpringSource - http://www.SpringSource.com- Spring Training, Consulting, and Support - "From the Source"
    http://twitter.com/costinl
    Please use [ c o d e ] [ / c o d e ] tags

  3. #3

    Default

    I would like to have following support:

    ready made mapper, reducer which accepts name of batch job to execute.

    ItemReader, ItemWriter for reading/writing writables from/to context.

    I am currently in process implementing spring batch on top of spring hadoop, so i am not sure if something else is needed.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •