Ressource Management
- Victor Leroux (Unlicensed)
Owned by Victor Leroux (Unlicensed)
Zoom on the hardware architecture
.png?version=1&modificationDate=1506949104796&cacheVersion=1&api=v2)
How jobs impact available servers
Schema Full Saagie
Schema Saagie on Top of a Datalake
.png?version=1&modificationDate=1506949105728&cacheVersion=1&api=v2)
Rules
| Node types | Resident Services | Scheduled or Streaming Jobs |
|---|---|---|
| Data Node | HDFS Yarn/Map reduce (aslo Hive) Impala Drill | Docker Spark R Python Sqoop Talend Java-Scala Datascience Notebook (depends of your settings) |
| Datamart | Mongo Db MySQL PostGreSQL (1.5) Elastic Search (1.5) | |
| Dataviz | Docker Datascience Notebook (depends of your settings) | |
| Kafka Node | Kafka | |
| Compute Edge Node | Datascience Notebook (depends of your settings) | |
| GPU Edge Node |