Meta Integration® Model Bridge (MIMB)
"Metadata Integration" Solution

MIMB Bridge Documentation

MIMB Import Bridge from Amazon S3 - New Beta Bridge

Bridge Specifications

Vendor Amazon
Tool Name Simple Storage Service (S3)
Tool Version 1.0
Tool Web Site http://aws.amazon.com/s3/
Supported Methodology [Database] Multi-Model via Java API

Import tool: Amazon Simple Storage Service (S3) 1.0 (http://aws.amazon.com/s3/)
Import interface: [Database] Multi-Model via Java API from Amazon S3 - New Beta Bridge
Import bridge: 'AmazonS3' 10.0.0

IMPORTING FROM Amazon Simple Storage Service.

This bridge establishes a connection with a choosed bucket in order to extract the physical metadata. It is critical that the parameters are filled correctly in order to satisfy the local connection requirements on the client workstation that runs the bridge. Please refer to the individual parameter's tool tips for more detailed examples.

IMPORTANT! The bridge uses aws-java-sdk-s3.
The easiest way to get it - is to download ZIP archive from http://sdk-for-java.amazonwebservices.com/latest/aws-java-sdk.zip
and extract all JAR files from 'third-party/lib/' folder and aws-java-sdk-*.jar from 'lib' folder to '${MODEL_BRIDGE_HOME}\java\S3'
Also, You can use apache maven to download only necessary JARs

Maven dependency include example:
...
<dependency>
<groupId>com.amazonaws</groupId>
<artifactId>aws-java-sdk-s3</artifactId>
<version>1.11.23</version>
</dependency>
...
Please visit http://docs.aws.amazon.com/java-sdk/latest/developer-guide/setup-install.html for detailed info.


Bridge Parameters

Parameter Name Description Type Values Default Scope
Bucket Bucket name STRING      
Access Key Your access key id to sign programmatic requests to AWS services. STRING      
Secret Key Your secret key to sign programmatic requests to AWS services. PASSWORD      
Root directory Enter the directory containing metadata files DIRECTORY      
Subdirectory filter Filter of subdirectories expressed using the Java regular expression pattern syntax (e.g. '.*_xyz' - import subdirectories that end with _xyz).
You can define multiple conditions separated with spaces (e.g. 'x y' - import sub directories that called x or y). When a condition has spaces it must be quoted (e.g. 'x y' - import sub directories that called 'x y'). You can define an exclusion condition by putting the dash character in front of it (e.g. '-test' - skip all 'test' directories).
The Java regular expression documentation is available at: https://docs.oracle.com/javase/7/docs/api/java/util/regex/Pattern.html
STRING      
File filter Similar to the directory filter parameter STRING      
Partition directories filter Files-based partition directories to skip.
This option is used to import a directory and all files inside this directory as a partition DataSet object.
STRING      
Miscellaneous Specify miscellaneous options identified with a -letter and value.

For example, -m 4G -f 100 -j -Dname=value -Xms1G

-m the maximum Java memory size whole number (e.g. -m 4G or -m 2500M ).
-s import system objects that are skipped by default (e.g. -s)
-v set environment variable(s) (e.g. -v var1=value -v var2="value with spaces").
-j the last option that is followed by Java command line options (e.g. -j -Dname=value -Xms1G).
STRING      

 

Bridge Mapping

Mapping information is not available

Last updated on Thu, 8 Feb 2018 17:19:37

Copyright © Meta Integration Technology, Inc. 1997-2018 All Rights Reserved.

Meta Integration® is a registered trademark of Meta Integration Technology, Inc.
All other trademarks, trade names, service marks, and logos referenced herein belong to their respective companies.