Meta Integration® Model Bridge (MIMB)
"Metadata Integration" Solution

MIMB Bridge Documentation

MIMB Import Bridge from Apache Sqoop

Bridge Specifications

Vendor Apache
Tool Name Sqoop
Tool Version 1.0
Tool Web Site http://sqoop.apache.org/
Supported Methodology [Data Integration] Multi-Model, Data Store (Physical Data Model), (Source and Target Data Stores, Transformation Lineage, Expression Parsing, Expression Conversion) via SQL TXT File

Import tool: Apache Sqoop 1.0 (http://sqoop.apache.org/)
Import interface: [Data Integration] Multi-Model, Data Store (Physical Data Model), (Source and Target Data Stores, Transformation Lineage, Expression Parsing, Expression Conversion) via SQL TXT File from Apache Sqoop
Import bridge: 'ApacheSqoop' 10.0.0

IMPORTING FROM APACHE SQOOP SCRIPTS


Bridge Parameters

Parameter Name Description Type Values Default Scope
Directory Select a directory that contains Sqoop scripts to import DIRECTORY     Mandatory
File Filter Specify a search filter for files. Use regular expressions in java format if needed (e.g. '.*\.sql'). Multiple conditions can be defined by using a space as a separator (e.g. 'file1 file2'). The condition must be escaped with double quotes if it contains any spaces inside (e.g. "my file.sql"). Negation can be defined with the preceeding dash character (e.g. '-\.tar\.gz'). STRING      
Miscellaneous Specify miscellaneous options identified with a -letter and value.

For example, -s c:\values.txt -e UTF-16
or
-p /user/cloudera

-s: path to a file that resolves Shell parameters. This parameter can be used to define a path to the key/value pair file that will be used to preprocess the script files and replace Shell parameters with the actual values. The file must have the following format:
key1:value1
key2:value2
-e: encoding. This value will be used to load text from the specified script files. By default, UTF-8 will be used. Here are some other possible values: UTF-16, UTF-16BE, US-ASCII.
-p: HDFS parent for table destination. The value will be used to form target directory path when Sqoop arguments --target-dir and --warehouse-dir are not specified.
For example, if imported table is 'country' and the parameter is '-p /user/cloudera' then target directory will be '/user/cloudera/country'
STRING      

 

Bridge Mapping

Mapping information is not available

Last updated on Fri, 15 Dec 2017 18:39:23

Copyright © Meta Integration Technology, Inc. 1997-2017 All Rights Reserved.

Meta Integration® is a registered trademark of Meta Integration Technology, Inc.
All other trademarks, trade names, service marks, and logos referenced herein belong to their respective companies.