Talend - Add settings in Platform Saagie

Preamble

Advantage: Choose your environment more easily (Develop, Production, etc...) when your job is ready.

Create a group of context - With Security

For create a group of context use the first publication (Create a group of context).

But, when you add the variable: Add just the column "NAME" and "TYPE".

It's very important that the column "Value" remains empty.

 

 

Example : Use a group of context - With Security (through the platform "Saagie")

  • Compress the file containing your job
  • Add the file to the platform "Saagie"
  • Change your command on the "Command to launch job":
    sh {file} --context_param IP_Impala="178.20.60.80"  --context_param Port_Impala="87452"  --context_param IP_HDFS="178.65.23.45"  --context_param Port_HDFS="78456"

Example : Use a group of context - With Security AND Use "Environment Variables"  (through the platform "Saagie")

  • Compress the file containing your job
  • Add "Envrionment Variables" :
    • In the platform "Saagie", Click on "Settings"
    • Create a variable
    • Click on "Add Variable"
  • Add the file to the platform "Saagie"
  • Change your command on the "Command to launch job":
    sh {file} --context_param IP_Impala=$IP_IMPALA --context_param Port_Impala=$PORT_IMPALA  --context_param IP_HDFS=$IP_HDFS  --context_param Port_HDFS=$Port_HDFS