Results 1 to 2 of 2

Thread: Initialize properties of Hadoop job from Spring Batch JobParameters

  1. #1
    Join Date
    Aug 2012
    Posts
    10

    Default Initialize properties of Hadoop job from Spring Batch JobParameters

    Does any one know how to initialize properties of hadoop job from spring batch jobParameters , Please let me know how to do this.

    Following is the scenarion I am trying to pass additional properties to hadoop job as follows.

    <hdp:job id="wordcount-job" validate-paths="false" scope="step"
    input-path="#{jobParameters['inputFile']}" output-path="#{jobParameters['outputFile']}"
    mapper="org.apache.hadoop.examples.WordCount.Token izerMapper"
    reducer="org.apache.hadoop.examples.WordCount.IntS umReducer" properties-ref="jobProperties" >
    </hdp:job>

  2. #2
    Join Date
    Jan 2005
    Location
    Bucharest, Romania
    Posts
    5,403

    Default

    As I replied in the other thread, this is a Spring Batch specific issue that is best addressed by looking at the their sample. You can use either a file for initialization (similar to the property placeholder), system properties or even device your own mechanism.
    Costin Leau
    SpringSource - http://www.SpringSource.com- Spring Training, Consulting, and Support - "From the Source"
    http://twitter.com/costinl
    Please use [ c o d e ] [ / c o d e ] tags

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •