Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Table of Contents

...

An default anonymization process in scala is proposed by Saagie. The code source is available here : https://github.com/saagie/outis.

You can use it as is, change it or replace it with one of your process.

To use it, build jar and create Spark processing job on platform with command line : 

...

  • You don't provide an entry date
  • You don't provide a list of fields to anonymize
  • If you provide a string field as an entry date without a pattern to parse the data
  • Dataset isn't csv or parquet files on table
No record anonymization if : 

...

This covers these types : Byte, Short, Int, Long, Float, Double and BigDecimal.

Error

You can find execution errors of the job in Error Output part of Job Logs.