5
0
mirror of https://github.com/apache/sqoop.git synced 2025-05-04 13:10:39 +08:00
Go to file
Venkat Ranganathan a970e60e07 SQOOP-1291: Sqoop2: Binary package do not have top level commands executable
(Jarek Jarcec Cecho via Venkat Ranganathan)
2014-02-24 10:23:42 -08:00
client SQOOP-1183 Sqoop2. Add getConnector(String) to the client API 2013-08-27 16:16:10 -07:00
common SQOOP-1234. Sqoop2: Clean up comments in MSubmission class 2014-02-02 21:09:16 -08:00
connector SQOOP-1258. Sqoop2: FrameworkMetadataUpgrade can't handle new inputs 2013-12-13 19:24:47 -08:00
core SQOOP-1254. Sqoop2: Tool: Add Upgrade tool 2013-12-13 21:46:19 -08:00
dev-support SQOOP-1144. Sqoop2: Add fixVersion to PreCommit branch detection 2014-02-02 21:02:28 -08:00
dist SQOOP-1291: Sqoop2: Binary package do not have top level commands executable 2014-02-24 10:23:42 -08:00
docs SQOOP-1266. Introduce Sqoop2 top-level commands 2014-01-16 11:53:31 -08:00
execution SQOOP-1210: Exporting data with malformed records causes sqoop2 jobs to hang until killed or they timeout 2013-10-02 09:14:31 -07:00
repository SQOOP-1211: Sqoop2: Derby repo: Sync maximal length of versions 2013-10-07 12:14:38 -07:00
server SQOOP-1232. Sqoop2: Provide tooling infrastructure for Sqoop2 2013-12-03 17:08:25 -08:00
shell SQOOP-1233. Remove unnecessary explicit call to MessageFormat. 2014-02-02 20:56:18 -08:00
spi SQOOP-1073: Sqoop2: Introduce schema for transferred data 2013-06-30 21:05:50 -07:00
submission SQOOP-1121. Sqoop2: Serialize schema and make them available in the MR job. 2013-07-10 10:57:54 -07:00
test SQOOP-1153. Sqoop2: Integration: Add test for enabling and disabling connections and objects 2013-10-23 23:04:00 -07:00
tomcat SQOOP-1263: Using CATALINA_HOME as CATALINA_BASE 2013-12-21 00:36:24 -08:00
tools SQOOP-1285. Sqoop2: ToolRunner is not exiting with proper exit value on error. 2014-02-09 15:08:41 -08:00
.gitattributes SQOOP-651: adding .gitattributes to prevent CRLF and LF mismatches for source and text files 2012-10-25 15:40:22 -07:00
.gitignore SQOOP-1082: Implement pre-commit testing with Jenkins 2013-06-23 18:30:31 -04:00
CHANGELOG.txt SQOOP-1202. Update Changelog for Sqoop 1.99.3 release 2013-10-11 21:34:15 -07:00
LICENSE.txt SQOOP-786: Include jars from WAR archive in LICENSE.txt file 2012-12-17 14:07:23 -08:00
NOTICE.txt SQOOP-1005: Sqoop2: Update year in the notice file to 2013 2013-06-15 15:15:59 -04:00
pom.xml SQOOP-1247. Sqoop2: Add sqoop-tomcat dependency to distribution module. 2013-12-06 10:58:15 -08:00
README.txt SQOOP-772: OutOfMemory from document generation 2012-12-17 13:24:28 -08:00

= Welcome to Sqoop

Apache Sqoop is a tool designed for efficiently transferring bulk data between
Apache Hadoop and structured datastores such as relational databases. You can use
Sqoop to import data from external structured datastores into Hadoop Distributed
File System or related systems like Hive and HBase. Conversely, Sqoop can be used
to extract data from Hadoop and export it to external structured datastores such
as relational databases and enterprise data warehouses.

== Documentation

Sqoop ships with documentation, please check module "docs" for additional materials.

More documentation is available online on Sqoop home page:

http://sqoop.apache.org/

== Compiling Sqoop

Sqoop uses the Maven build system, and it can be compiled and built running the
following commands:

  mvn compile # Compile project
  mvn package # Build source artifact
  mvn package -Pbinary # Build binary artifact

Sqoop is using Sphinx plugin to generate documentation that have higher memory
requirements that might not fit into default maven configuration. You might need
to increase maximal memory allowance to successfully execute package goal. This
can done using following command:

  export MAVEN_OPTS="-Xmx512m -XX:MaxPermSize=512m"

Sqoop currently supports multiple Hadoop distributions. In order to compile Sqoop
against a specific Hadoop version, please specify the hadoop.profile property in
Maven commands. For example:

  mvn package -Pbinary -Dhadoop.profile=100

Please refer to the Sqoop documentation for a full list of supported Hadoop
distributions and values of the hadoop.profile property.