...
Gist Page : example-python-read-and-write-from-hive-with-security
Common part
Libraries dependency and some configuration
| Code Block | ||
|---|---|---|
| ||
import ibis
import pandas as pd
import os
# ====== Ibis conf (to avoid a bug) ======
with ibis.config.config_prefix('impala'):
ibis.config.set_option('temp_db', '`__ibis_tmp`') |
WEBHDFS URI
WEBHDFS URI are like that : http://namenodedns:port/user/hdfs/folder/file.csv
...