github/sqoop
5
0
Fork 0
mirror of https://github.com/apache/sqoop.git synced 2025-05-03 15:50:28 +08:00
Code Issues Projects Releases Wiki Activity
64 Commits 21 Branches 30 Tags 24 MiB
Java 97.7%
Shell 0.9%
XSLT 0.4%
Python 0.3%
Batchfile 0.3%
Other 0.3%
bb29ce9492
Go to file
Andrew Bayer bb29ce9492 Support for CLOB/BLOB data in external files. 
CLOB/BLOB data may now be stored in additional files in HDFS which are
accessible through streams if the data cannot be fully materialized in RAM.
Adds tests for external large objects.
Refactored large object loading into the map() method from readFields().

From: Aaron Kimball <aaron@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149866 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:35 +00:00
conf MAPREDUCE-750. Extensible ConnManager factory API. Contributed by Aaron Kimball. 2011-07-22 20:03:23 +00:00
ivy Compilation, dependency resolution, and tests pass. 2011-07-22 20:03:34 +00:00
lib Compilation, dependency resolution, and tests pass. 2011-07-22 20:03:34 +00:00
src Support for CLOB/BLOB data in external files. 2011-07-22 20:03:35 +00:00
testdata/hive MAPREDUCE-1341. Sqoop should have an option to create hive tables and skip the table import step. Contributed by Leonid Furman. 2011-07-22 20:03:32 +00:00
.gitignore Compilation, dependency resolution, and tests pass. 2011-07-22 20:03:34 +00:00
build.xml Improve batch testrunner support for third-party tests. 2011-07-22 20:03:35 +00:00
ivy.xml Compilation, dependency resolution, and tests pass. 2011-07-22 20:03:34 +00:00
LICENSE.txt Compilation, dependency resolution, and tests pass. 2011-07-22 20:03:34 +00:00
README.txt Compilation, dependency resolution, and tests pass. 2011-07-22 20:03:34 +00:00
svn-placeholder Placeholder commit 2011-07-22 19:59:57 +00:00

README.txt 

= Welcome to Sqoop!

This is the Sqoop (SQL-to-Hadoop) tool. Sqoop allows easy imports and
exports of data sets between databases and HDFS.


== More Documentation

Sqoop ships with additional documentation: a user guide and a manual page.

Asciidoc sources for both of these are in +src/docs/+. Run +ant docs+ to build
the documentation. It will be created in +build/docs/+.

If you got Sqoop in release form, documentation will already be built and
available in the +docs/+ directory.


== Compiling Sqoop

Compiling Sqoop requires the following tools:

* Apache ant (1.7.1)
* Java JDK 1.6

Additionally, building the documentation requires these tools:

* asciidoc
* make
* python 2.5+
* xmlto
* tar
* gzip

To compile Sqoop, run +ant package+. There will be a fully self-hosted build
provided in the +build/sqoop-(version)/+ directory. 

You can build just the jar by running +ant jar+.


== This is also an Asciidoc file!

* Try running +asciidoc README.txt+
* For more information about asciidoc, see http://www.methods.co.nz/asciidoc/