Preamble

To create the different jobs displayed in this article, you have to create a repository: With VALUES

Query from MongoDB (with all versions of Data Fabric)

Create a new job
Add the component "tMongoDBConnection" : Allows the creation of a MongoDB connection.
Add the component "tMongoDBInput" : Read collection documents based on an query document.
Add the component "tAggregateRow" : Receives a flow and aggregates it based on one or more columns.
Add the component "tLogRow' : Display the result.
Create links:
- "tMongoDBConnection" is connected with "tMongoDBInput" (through "OnSubjobOk")
- "tMongoDBInput" is connected with "tAggregateRow" (through Main")
- "tAggregateRow" is connected with "tLogRow" (through "Main")

Double click on the component "tAggregateRow" :
- Click on "Edit a schema"
  - Add the column "sum" in output
- In the field "operations", set its properties :

This article isn't available with Data Fabric >= 1.6 because it's not secure.

Solution :

Create a new job
Add the component "tMongoDBConnection" : Allows the creation of a MongoDB connection.
Add the component "tImpalaConnection" : Allows the creation of an Impala connection.
Add the component "tImpalaInput": Reads an Impala table and extracts fields based on an Impala Query.
Add the component "tMongoDBOutput': Inserts or Updates documents into a mongoDB collection.
Create links:
- "tMongoDBConnection" is connected with "tImpalaConnection" (through "OnSubjobOk")
- "tImpalaConnection" is connected with "tImpalaInput" (through "OnSubjobOk")
- "tImpalaInput" is connected with "tMongoDBOutput" (through "Main")

Double click on "tImpalaConnection" and set its properties:
- Add a "Cloudera" distribution and select the latest version of Cloudera
- Enter a host
- Enter a port
- Enter a name of BDD

Double click on the component "tMongoDBOutput":
- Tick "Use an existing connection"
- Enter a name collection