5
0
mirror of https://github.com/apache/sqoop.git synced 2025-05-04 04:49:43 +08:00
Go to file
Jarek Jarcec Cecho b49b71235d SQOOP-941: Sqoop2: Do not send sensitive values from server to client
(Abraham Elmahrek via Jarek Jarcec Cecho)
2013-03-23 08:03:10 -07:00
client SQOOP-941: Sqoop2: Do not send sensitive values from server to client 2013-03-23 08:03:10 -07:00
common SQOOP-941: Sqoop2: Do not send sensitive values from server to client 2013-03-23 08:03:10 -07:00
connector SQOOP-903: Sqoop2: Add schema support to Generic JDBC Connector 2013-03-15 13:22:07 -07:00
core SQOOP-892:: Validate acceptable number of mappers and reducers 2013-02-23 19:23:27 -08:00
dist SQOOP-889: Move tomcat related properties from dist/pom.xml to root pom.xml 2013-02-22 12:19:06 -08:00
docs Sqoop2: Devguide: Building and setting up developer environment. 2013-03-11 08:41:13 +05:30
execution SQOOP-783: Sqoop2: Merge HdfsSequenceExportExtractor and HdfsTextExportExtractor to one Extractor 2013-03-17 12:27:21 -07:00
repository SQOOP-900: Introduce human readable coding style for queries stored in DerbySchemaQuery 2013-02-22 13:26:03 -08:00
server SQOOP-941: Sqoop2: Do not send sensitive values from server to client 2013-03-23 08:03:10 -07:00
spi SQOOP-864: Introduce ETL context objects 2013-02-10 12:55:31 -08:00
submission SQOOP-851: NullPointerException in Mapreduce Submission engine initialization 2013-01-31 09:47:56 -08:00
test SQOOP-919: Improve Form API for simple java handling 2013-03-10 22:57:20 -07:00
.gitattributes SQOOP-651: adding .gitattributes to prevent CRLF and LF mismatches for source and text files 2012-10-25 15:40:22 -07:00
.gitignore SQOOP-833: add *.eml "ant eclipse" (IntelliJ import) generated file, to .gitignore 2013-01-22 09:55:32 -08:00
CHANGELOG.txt Updating CHANGELOG file with recently committed changes. 2012-12-21 12:01:50 -08:00
LICENSE.txt SQOOP-786: Include jars from WAR archive in LICENSE.txt file 2012-12-17 14:07:23 -08:00
NOTICE.txt SQOOP-800 Update NOTICE file 2012-12-21 11:53:23 -08:00
pom.xml SQOOP-908: Create MySQL and PostgreSQL database providers 2013-03-01 16:06:20 -08:00
README.txt SQOOP-772: OutOfMemory from document generation 2012-12-17 13:24:28 -08:00

= Welcome to Sqoop

Apache Sqoop is a tool designed for efficiently transferring bulk data between
Apache Hadoop and structured datastores such as relational databases. You can use
Sqoop to import data from external structured datastores into Hadoop Distributed
File System or related systems like Hive and HBase. Conversely, Sqoop can be used
to extract data from Hadoop and export it to external structured datastores such
as relational databases and enterprise data warehouses.

== Documentation

Sqoop ships with documentation, please check module "docs" for additional materials.

More documentation is available online on Sqoop home page:

http://sqoop.apache.org/

== Compiling Sqoop

Sqoop uses the Maven build system, and it can be compiled and built running the
following commands:

  mvn compile # Compile project
  mvn package # Build source artifact
  mvn package -Pbinary # Build binary artifact

Sqoop is using Sphinx plugin to generate documentation that have higher memory
requirements that might not fit into default maven configuration. You might need
to increase maximal memory allowance to successfully execute package goal. This
can done using following command:

  export MAVEN_OPTS="-Xmx512m -XX:MaxPermSize=512m"

Sqoop currently supports multiple Hadoop distributions. In order to compile Sqoop
against a specific Hadoop version, please specify the hadoop.profile property in
Maven commands. For example:

  mvn package -Pbinary -Dhadoop.profile=100

Please refer to the Sqoop documentation for a full list of supported Hadoop
distributions and values of the hadoop.profile property.