5
0
mirror of https://github.com/apache/sqoop.git synced 2025-05-05 20:13:29 +08:00
Go to file
Jarek Jarcec Cecho 418b9a70f8 SQOOP-1579: Sqoop2: Data transfer to load into Hive does not work
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-02-27 06:49:04 -08:00
client SQOOP-2101: Sqoop2: Add SqoopClient support to call Restful API 2015-02-17 13:02:04 -08:00
common SQOOP-1516: Sqoop2: Config Input as a Top Level Entity - RepositoryAPI changes 2015-02-25 13:56:56 -08:00
common-test SQOOP-2081: Sqoop2: Provide ability to dump content of testing table to log 2015-02-05 15:24:23 -08:00
connector SQOOP-1579: Sqoop2: Data transfer to load into Hive does not work 2015-02-27 06:49:04 -08:00
core SQOOP-1516: Sqoop2: Config Input as a Top Level Entity - RepositoryAPI changes 2015-02-25 13:56:56 -08:00
dev-support SQOOP-2124: Sqoop2: Pre-Commit hook should report how many tests are executed 2015-02-20 15:30:46 -08:00
dist SQOOP-2102: Binary tarball missing executable bit on sqoop2-* files 2015-02-12 12:31:32 -08:00
docs SQOOP-2122: Sqoop2: Build documentation only in binary packaging profile 2015-02-20 15:55:38 -08:00
execution SQOOP-1746: Sqoop2: Mapreduce job is running in DEBUG mode by default 2015-02-20 09:51:15 -08:00
repository SQOOP-1790: Sqoop2: Upgrade configs with name conflicts 2015-02-26 07:09:39 -08:00
security SQOOP-2080: Sqoop2: Combine privileges into READ and WRITE 2015-02-17 13:08:02 -08:00
server SQOOP-2019: Sqoop2: Handle post-function for updating/deleting resource 2015-02-19 11:51:31 -08:00
shell SQOOP-2123: Sqoop2: Copy shell libraries only in binary package profile 2015-02-20 15:54:08 -08:00
submission SQOOP-1592: Sqoop2: Remove Hadoop1 profile 2015-02-09 11:42:24 -08:00
test SQOOP-1579: Sqoop2: Data transfer to load into Hive does not work 2015-02-27 06:49:04 -08:00
tomcat SQOOP-1950. Sqoop2: Use TestNG 2015-01-08 16:41:18 -08:00
tools SQOOP-1577: Sqoop2: Refactor repository dump and load tools 2015-02-20 08:44:57 -08:00
.gitattributes SQOOP-651: adding .gitattributes to prevent CRLF and LF mismatches for source and text files 2012-10-25 15:40:22 -07:00
.gitignore SQOOP-1339: Synchronize .gitignore files 2014-06-24 09:05:20 -07:00
CHANGELOG.txt SQOOP-2114: RC2 version of changelog.txt 2015-02-18 09:18:21 -08:00
LICENSE.txt SQOOP-2093: Update License.txt 2015-02-10 11:57:59 -08:00
NOTICE.txt SQOOP-1005: Sqoop2: Update year in the notice file to 2013 2013-06-15 15:15:59 -04:00
pom.xml SQOOP-2134: Update Kite dependency to 1.0.0 2015-02-25 16:02:21 -08:00
README.txt SQOOP-772: OutOfMemory from document generation 2012-12-17 13:24:28 -08:00

= Welcome to Sqoop

Apache Sqoop is a tool designed for efficiently transferring bulk data between
Apache Hadoop and structured datastores such as relational databases. You can use
Sqoop to import data from external structured datastores into Hadoop Distributed
File System or related systems like Hive and HBase. Conversely, Sqoop can be used
to extract data from Hadoop and export it to external structured datastores such
as relational databases and enterprise data warehouses.

== Documentation

Sqoop ships with documentation, please check module "docs" for additional materials.

More documentation is available online on Sqoop home page:

http://sqoop.apache.org/

== Compiling Sqoop

Sqoop uses the Maven build system, and it can be compiled and built running the
following commands:

  mvn compile # Compile project
  mvn package # Build source artifact
  mvn package -Pbinary # Build binary artifact

Sqoop is using Sphinx plugin to generate documentation that have higher memory
requirements that might not fit into default maven configuration. You might need
to increase maximal memory allowance to successfully execute package goal. This
can done using following command:

  export MAVEN_OPTS="-Xmx512m -XX:MaxPermSize=512m"

Sqoop currently supports multiple Hadoop distributions. In order to compile Sqoop
against a specific Hadoop version, please specify the hadoop.profile property in
Maven commands. For example:

  mvn package -Pbinary -Dhadoop.profile=100

Please refer to the Sqoop documentation for a full list of supported Hadoop
distributions and values of the hadoop.profile property.