Meta Integration® Model Bridge (MIMB)
"Metadata Integration" Solution

MIMB Bridge Documentation

MIMB Import Bridge from Apache Hadoop Hive Database (Hive Metastore via JDBC)

Bridge Specifications

Vendor Apache
Tool Name Hadoop Hive Database
Tool Version 0.13
Tool Web Site http://hive.apache.org/
Supported Methodology [Relational Database] Data Store (Physical Data Model) via JDBC API

Import tool: Apache Hadoop Hive Database 0.13 (http://hive.apache.org/)
Import interface: [Relational Database] Data Store (Physical Data Model) via JDBC API from Apache Hadoop Hive Database (Hive Metastore via JDBC)
Import bridge: 'ApacheHiveMetastore' 10.0.1

IMPORTING FROM HIVE METASTORE DATABASE USING JDBC.

This bridge establishes a JDBC connection to the hive metastore database server in order to extract the physical metadata. It is critical that the parameters are filled correctly to satisfy the local connection requirements on the client workstation that runs the bridge. Please refer to the individual parameter's tool tips for more detailed examples.



Bridge Parameters

Parameter Name Description Type Values Default Scope
Driver location
It's very important to specify valid JARs folder location. All JARs will be added to the CLASSPATH from this folder.

DIRECTORY     Mandatory
Driver class Please copy/paste here 'javax.jdo.option.ConnectionDriverName' value from your hive-site.xml
Usually, this file is located in '/etc/alternatives/hive-conf'
or in an another place depends on you Hadoop/Hive configuration

Examples:
com.mysql.jdbc.Driver
STRING   com.mysql.jdbc.Driver Mandatory
URL Please find 'javax.jdo.option.ConnectionURL' value from your hive-site.xml
and define connection to DB server (mySQL, PostgreSQL,.. etc.) URL

(Example:jdbc:mysql://127.0.0.1)

Usually, this file is located in '/etc/alternatives/hive-conf'
or in an another place depends on you Hadoop/Hive configuration
STRING   jdbc:mysql://127.0.0.1 Mandatory
Metastore Database name Please check 'javax.jdo.option.ConnectionURL' value from your hive-site.xml to determine Hive Metastore Database name
Usually, this file is located in '/etc/alternatives/hive-conf'
or in an another place depends on you Hadoop/Hive configuration

STRING     Mandatory
User The Hive username on whose behalf the connection is being made.

STRING      
Password The Hive user's password on whose behalf the connection is being made PASSWORD      
Schema Description: you can specify a list of Hive schemas to import.
When the list is empty, all available schemas are imported.
The list can have one or more schema names separated by semicolons (e.g. schema1; schema2).

You can specify schema name patterns using '%' wilcard symbol or 'NOT' keyword.

Patterns support inclusions and exclusions.
Here is an example of inclusion syntax, "A%; %B; %C%; D" that tries to get schema names that:
- start with A or
- end with B or
- contain C or
- equal D

To exclude a pattern, prefix it with 'NOT'. Here is an example of exclusion syntax, "A%; NOT %def"
that imports schemas with name started with 'A' and not ended with 'def'
REPOSITORY_SUBSET      
Table Description: you can specify a list of Hive tables to import.
When the list is empty, all available tables are imported.
The list can have one or more table names separated by semicolons (e.g. sample_07; sample_08).

You can specify table name patterns using '%' wilcard symbol or 'NOT' keyword.

Patterns support inclusions and exclusions.
Here is an example of inclusion syntax, "A%; %B; %C%; D" that tries to get table names that:
- start with A or
- end with B or
- contain C or
- equal D

To exclude a pattern, prefix it with 'NOT'. Here is an example of exclusion syntax, "A%; NOT %def"
that imports tables with name started with 'A' and not ended with 'def'
STRING      
Miscellaneous Specify miscellaneous options identified with a -letter and value.

For example, -m 4G -t 6 -f 100 -j -Dname=value -Xms1G

-f the database driver fetch size in number of rows (e.g. -f 100)

-m the maximum Java memory size whole number (e.g. -m 4G or -m 2500M ).

-v set environment variable(s) (e.g. -v var1=value -v var2="value with spaces").

-j the last option that is followed by Java command line options (e.g. -j -Dname=value -Xms1G).

-noext disable tables connections to external files
STRING      

 

Bridge Mapping

Mapping information is not available

Last updated on Mon, 3 Dec 2018 18:35:45

Copyright © Meta Integration Technology, Inc. 1997-2018 All Rights Reserved.

Meta Integration® is a registered trademark of Meta Integration Technology, Inc.
All other trademarks, trade names, service marks, and logos referenced herein belong to their respective companies.