Choose your Java version

Owned by Aurèle Morvan (Unlicensed)
Last updated: Aug 19, 2016 by Youen Chene (Unlicensed)

(Saagie v0.9 Astérix)

spark-submit defaults to Java 1.7

If your job jar was compiled with Java 1.8, you should change the JAVA_HOME environment variable accordingly:

replace the default command:

spark-submit {driver_options} --class=MyClass {file} arg1 arg2

with:

;
export JAVA_HOME=/usr/lib/jvm/java-8-oracle;
/opt/spark/1.6/bin/spark-submit {driver_options} --class=MyClass {file} arg1 arg2;

 

Note that JAVA_HOME is only set for the duration of the job execution. It will not affect other jobs.