Versions Compared

Old Version 3

changes.mady.by.user Erwan Koffi

Saved on

compared with

New Version Current

changes.mady.by.user Erwan Koffi

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
languagejava
// ======= Reading files
// Reading parquet files into a Spark Dataframe
val df_parquet = session.read.parquet(hdfs_master + "user/hdfs/wiki/testwiki")
//  Reading csv files into a Spark Dataframe
val df_csv = session.read.csv(hdfs_master + "user/hdfs/wiki/testwiki.csv")
val df_csv = sessionsparkSession.read.option("inferSchema", "true").csv(hdfs_master + "user/hdfs/wiki/testwiki.csv")

...