Talend - Query from Drill

Owned by Charline Simon (Unlicensed)

Last updated: Dec 14, 2017

2 min read

Github Project : example-talend-query-from-Drill

Preamble

Configuration: Context

To create the different jobs displayed in this article, you have to create a repository : With VALUES

Query from Drill (with all versions of Data Fabric)

Example: Count the number of lines.

Create a new job
Add the component "tJDBCConnection" : allows the creation of a JDBC database connection
Add the component "tJDBCInput" : reads a DB table and extracts fields based on an SQL query
Add the component "tLogRow" : displays results
Create links:
- "tJDBCConnection" is connected with "tJDBCInput" (through "OnSubjobOk")
- "tJDBCInput" is connected with "tLogRow" (through "Main")

Double click on "tJDBCConnection" and set its properties:
- Enter a URL JDBC
- Add a driver Jar.
  - Download the jar : https://drill.apache.org/docs/using-the-jdbc-driver/ and use "drill-jdbc-all-1.8.0.jar"
- Enter a driver class. For Drill, the name of driver class is "org.apache.drill.jdbc.Driver".

- Click on the tab "Advanced settings" and untick "Use a auto-commit"

Double click on "tJDBCInput" and set its properties :
- Tick "Use an existing connection"
- Enter a name of table
- Enter your request : "SELECT COUNT(*) FROM " + context.Storage_Plugins_And_Name_Table_JDBC

Run a job