5
0
mirror of https://github.com/apache/sqoop.git synced 2025-05-04 02:21:10 +08:00
Go to file
Abraham Fine c74dda1b21 SQOOP-1916: Sqoop2: Yarn child leaking in integration tests
(Scott Kuehn via Abraham Fine)
2016-03-14 19:49:18 -07:00
assemblies SQOOP-2634: Sqoop2: Provide classpath isolation for connectors and its dependencies 2015-12-23 11:21:15 +01:00
client SQOOP-2771: Sqoop2: Remove the notion of SubmissionBean 2016-01-16 15:43:26 -08:00
common SQOOP-2844: Sqoop2: TrustStore support for shell 2016-03-08 12:39:28 -08:00
common-test SQOOP-2833: Sqoop2: Integration Tests: Allow setting which "time type" should be used based on the DatabaseProvider 2016-02-29 12:32:35 -08:00
connector SQOOP-2855: Sqoop2: Enrich Generic JDBC Connector resource file 2016-03-07 15:14:40 -08:00
core SQOOP-2845: Sqoop2: Derive keystore password from a script passed to configuration 2016-03-04 09:23:02 -08:00
dev-support SQOOP-2805: Sqoop2: Detect if both fixVersion and affectedVersions are empty and report it 2016-02-04 12:04:32 +08:00
dist SQOOP-2843: Sqoop2: Enable SSL/TLS for API calls 2016-02-26 09:37:04 -08:00
docs SQOOP-2876: Sqoop2: Document TLS support 2016-03-08 14:03:31 -08:00
execution SQOOP-1916: Sqoop2: Yarn child leaking in integration tests 2016-03-14 19:49:18 -07:00
repository SQOOP-2819: Use connector name instead of id in Repository.findJobsForConnector methods 2016-02-06 15:28:38 +08:00
security SQOOP-2739: Sqoop2: Use resource name instead of resource id in authorization engine 2015-12-18 08:14:17 +01:00
server SQOOP-2844: Sqoop2: TrustStore support for shell 2016-03-08 12:39:28 -08:00
shell SQOOP-2844: Sqoop2: TrustStore support for shell 2016-03-08 12:39:28 -08:00
submission SQOOP-2802: Sqoop2: Logging level should be debug for integration tests 2016-01-29 12:52:02 -08:00
test SQOOP-2844: Sqoop2: TrustStore support for shell 2016-03-08 12:39:28 -08:00
tools SQOOP-2771: Sqoop2: Remove the notion of SubmissionBean 2016-01-16 15:43:26 -08:00
.gitattributes SQOOP-651: adding .gitattributes to prevent CRLF and LF mismatches for source and text files 2012-10-25 15:40:22 -07:00
.gitignore SQOOP-1339: Synchronize .gitignore files 2014-06-24 09:05:20 -07:00
CHANGELOG.txt SQOOP-2336: Update change log with 1.99.6 release for RC-2 2015-04-28 19:36:19 -07:00
LICENSE.txt SQOOP-2304: Update license file 2015-04-17 01:12:09 -07:00
NOTICE.txt SQOOP-1005: Sqoop2: Update year in the notice file to 2013 2013-06-15 15:15:59 -04:00
pom.xml SQOOP-2866: Sqoop2: Add Abe Fine to committer list in our pom file 2016-03-04 11:47:52 -08:00
README.txt SQOOP-772: OutOfMemory from document generation 2012-12-17 13:24:28 -08:00

= Welcome to Sqoop

Apache Sqoop is a tool designed for efficiently transferring bulk data between
Apache Hadoop and structured datastores such as relational databases. You can use
Sqoop to import data from external structured datastores into Hadoop Distributed
File System or related systems like Hive and HBase. Conversely, Sqoop can be used
to extract data from Hadoop and export it to external structured datastores such
as relational databases and enterprise data warehouses.

== Documentation

Sqoop ships with documentation, please check module "docs" for additional materials.

More documentation is available online on Sqoop home page:

http://sqoop.apache.org/

== Compiling Sqoop

Sqoop uses the Maven build system, and it can be compiled and built running the
following commands:

  mvn compile # Compile project
  mvn package # Build source artifact
  mvn package -Pbinary # Build binary artifact

Sqoop is using Sphinx plugin to generate documentation that have higher memory
requirements that might not fit into default maven configuration. You might need
to increase maximal memory allowance to successfully execute package goal. This
can done using following command:

  export MAVEN_OPTS="-Xmx512m -XX:MaxPermSize=512m"

Sqoop currently supports multiple Hadoop distributions. In order to compile Sqoop
against a specific Hadoop version, please specify the hadoop.profile property in
Maven commands. For example:

  mvn package -Pbinary -Dhadoop.profile=100

Please refer to the Sqoop documentation for a full list of supported Hadoop
distributions and values of the hadoop.profile property.