Third-Party software (drivers) internet download

MIMB bridges requiring downloading third-party software are indicated with the following icon in the list of MIMB Supported Tools

img is a bridge requiring internet access to https://repo.maven.apache.org/maven2/ (and exceptionally a few other tool sites) in order to download the necessary third-party software drivers into $HOME/data/download/MIMB/ (such directory can be copied from another MIMB server with internet access).

The main documentation of such bridge also includes the following:

DISCLAIMER This import bridge requires internet access to download third-party libraries:

  • such as https://repo.maven.apache.org/maven2/ to download open source third-party libraries,
  • and more sites for other third-party software such as database specific JDBC drivers.

The downloaded third-party libraries are stored into $HOME/data/download/MIMB/

  • If HTTPS fails, the import bridge then tries with HTTP.
  • If a proxy is used to access internet, you must configure that proxy in the JRE (see the -j option in the Miscellaneous parameter).
  • If the import bridge does not have full access to internet, that $HOME/data/download/MIMB/ directory can be copied from another server with internet access where the command $HOME/bin/MIMB.sh (or .bat) -d can be used to download all third-party libraries used by all bridges at once.

By running this import bridge, you hereby acknowledge responsibility for the license terms and any potential security vulnerabilities from these downloaded third-party software libraries.

Within that context, here are the known limitations:

  • On Windows server 2016 (or newer), a message "Cannot execute hadoop.dll" can appear in the following bridges:

  • Amazon Web Services (AWS) S3 Storage (Import)

  • Apache Hadoop Distributed File System (HDFS Java API) (Import)

  • Apache Kafka (Import)

  • Excel File (XLSX) (Import)

  • File System (CSV, Excel, XML, JSON, Avro, Parquet, ORC, COBOL Copybook) (Import)

  • Flat File (CSV or Excel) - Beta Bridge (Import)

  • Metadata Excel Format (Export)

  • Metadata Excel Format (Import)

  • Microsoft Azure Blob Storage (Import)

  • Microsoft Azure Data Lake Storage (Import)

  • OpenStack Swift Object Store - New Beta Bridge (Import)

  • Oracle Cloud Object Storage Classic - New Beta Bridge (Import)

That is because the official hadoop.dll downloaded from the Maven repository has a dependency to the old Windows onmsvcr100.dll no longer delivered with the new Windows 2016 Server. The solution is add the missing C runtime msvcr100.dll.of by adding the Microsoft Visual C++ 2010 Service Pack 1 Redistributable Package MFC Security Update.