github/sqoop
5
0
Fork 0
mirror of https://github.com/apache/sqoop.git synced 2025-05-03 15:32:52 +08:00
Code Issues Projects Releases Wiki Activity
223 Commits 21 Branches 30 Tags 24 MiB
Java 97.7%
Shell 0.9%
XSLT 0.4%
Python 0.3%
Batchfile 0.3%
Other 0.3%
7677d39b79
Go to file
Andrew Bayer 7677d39b79 SQOOP-187. Allow skipping end-of-record delimiter. 
The SqoopRecord.toString() and SqoopRecord.toString(DelimiterSet) methods
always append an end-of-record delimiter. Sqoop uses its own OutputFormat
when rendering these to text files, so that the user's delimiters are
preserved.

Other users could use this OutputFormat when working with SqoopRecord
instances in their own MapReduce code, but it would also be nice to "play
nice" with TextOutputFormat in the event that the intent is
newline-terminated records.

This patch allows users to suppress end-of-record delimiter generation when
formatting records with toString.

(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150025 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:32 +00:00
bin SQOOP-180. Classpath construction in script. 2011-07-22 20:04:30 +00:00
conf SQOOP-178. Support for tool plugins. 2011-07-22 20:04:30 +00:00
ivy SQOOP-138. Fixing intermittent IVY failure. 2011-07-22 20:04:23 +00:00
lib SQOOP-133. Removing shim layer mechanism. 2011-07-22 20:04:22 +00:00
src SQOOP-187. Allow skipping end-of-record delimiter. 2011-07-22 20:04:32 +00:00
testdata/hive SQOOP-37. Escape table and column names for Hive. 2011-07-22 20:04:20 +00:00
.gitignore SQOOP-178. Support for tool plugins. 2011-07-22 20:04:30 +00:00
build.xml SQOOP-178. Support for tool plugins. 2011-07-22 20:04:30 +00:00
COMPILING.txt SQOOP-164. Allow unit tests to use external dbs. 2011-07-22 20:04:27 +00:00
ivy.xml SQOOP-138. Fixing intermittent IVY failure. 2011-07-22 20:04:23 +00:00
LICENSE.txt Changed license headers to reference Cloudera instead of the ASF. 2011-07-22 20:03:36 +00:00
NOTICE.txt Changed license headers to reference Cloudera instead of the ASF. 2011-07-22 20:03:36 +00:00
README.txt Add ability to compile against Cloudera or Apache Hadoop. 2011-07-22 20:03:41 +00:00
svn-placeholder Placeholder commit 2011-07-22 19:59:57 +00:00

README.txt 

= Welcome to Sqoop!

This is the Sqoop (SQL-to-Hadoop) tool. Sqoop allows easy imports and
exports of data sets between databases and HDFS.


== More Documentation

Sqoop ships with additional documentation: a user guide and a manual page.

Asciidoc sources for both of these are in +src/docs/+. Run +ant docs+ to build
the documentation. It will be created in +build/docs/+.

If you got Sqoop in release form, documentation will already be built and
available in the +docs/+ directory.


== Compiling Sqoop

Compiling Sqoop requires the following tools:

* Apache ant (1.7.1)
* Java JDK 1.6

Additionally, building the documentation requires these tools:

* asciidoc
* make
* python 2.5+
* xmlto
* tar
* gzip

To compile Sqoop, run +ant package+. There will be a fully self-hosted build
provided in the +build/sqoop-(version)/+ directory. 

You can build just the jar by running +ant jar+.

See the COMPILING.txt document for for information.

== This is also an Asciidoc file!

* Try running +asciidoc README.txt+
* For more information about asciidoc, see http://www.methods.co.nz/asciidoc/