github/sqoop
5
0
Fork 0
mirror of https://github.com/apache/sqoop.git synced 2025-05-03 11:30:41 +08:00
Code Issues Projects Releases Wiki Activity
138 Commits 21 Branches 30 Tags 24 MiB
Java 97.7%
Shell 0.9%
XSLT 0.4%
Python 0.3%
Batchfile 0.3%
Other 0.3%
06b94587af
Go to file
Andrew Bayer 06b94587af SQOOP-39. (SIP-6) Session Management API. 
Added SessionStorage API.
Added SessonData API.
Added SessionStorageFactory.
Added SessionTool for create/delete/execute/show/list operations on sessions.
SqoopOptions can read and write all "sticky" state to a Properties instance.
Added HsqldbSessionStorage to implement SessionStorage API.
Added AutoHsqldbStorage to auto-instantiate a local metastore for the user.
Added client metastore connection parameters to sqoop-site.xml.
Added metastore tool (MetastoreTool).
Added HsqldbMetaStore for standalone metastore instance.
Added metastore properties to sqoop-default.xml.
Added TestSessions unit tests of session API.
Renamed conf/sqoop-default.xml to conf/sqoop-site-template.xml.
Added conf/.gitignore for sqoop-site.xml.

Tests run:

Tested all metastore operations on an import session.
Tested that ~/.sqoop/-based storage will be auto-created by the metastore.
Tested that 'sqoop metastore'-based metastores can be connected to
by external clients.
Tested that 'sqoop metastore --shutdown' will gracefully shut down a running
metastore instance.
Tested that passwords are not stored in the metastore by default, and the
user is prompted for the password when executing that saved session.

From: Aaron Kimball <aaron@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149940 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:05 +00:00
bin SQOOP-14. Allow Sqoop to import data into HBase. 2011-07-22 20:04:03 +00:00
conf SQOOP-39. (SIP-6) Session Management API. 2011-07-22 20:04:05 +00:00
ivy SQOOP-14. Allow Sqoop to import data into HBase. 2011-07-22 20:04:03 +00:00
lib SQOOP-16. Generate Eclipse project with ant. 2011-07-22 20:04:01 +00:00
src SQOOP-39. (SIP-6) Session Management API. 2011-07-22 20:04:05 +00:00
testdata/hive Changed license headers to reference Cloudera instead of the ASF. 2011-07-22 20:03:36 +00:00
.gitignore SIP-1. Refactor operations into distinct tools. 2011-07-22 20:03:45 +00:00
build.xml SQOOP-39. (SIP-6) Session Management API. 2011-07-22 20:04:05 +00:00
COMPILING.txt SQOOP-16. Generate Eclipse project with ant. 2011-07-22 20:04:01 +00:00
ivy.xml SQOOP-14. Allow Sqoop to import data into HBase. 2011-07-22 20:04:03 +00:00
LICENSE.txt Changed license headers to reference Cloudera instead of the ASF. 2011-07-22 20:03:36 +00:00
NOTICE.txt Changed license headers to reference Cloudera instead of the ASF. 2011-07-22 20:03:36 +00:00
README.txt Add ability to compile against Cloudera or Apache Hadoop. 2011-07-22 20:03:41 +00:00
svn-placeholder Placeholder commit 2011-07-22 19:59:57 +00:00

README.txt 

= Welcome to Sqoop!

This is the Sqoop (SQL-to-Hadoop) tool. Sqoop allows easy imports and
exports of data sets between databases and HDFS.


== More Documentation

Sqoop ships with additional documentation: a user guide and a manual page.

Asciidoc sources for both of these are in +src/docs/+. Run +ant docs+ to build
the documentation. It will be created in +build/docs/+.

If you got Sqoop in release form, documentation will already be built and
available in the +docs/+ directory.


== Compiling Sqoop

Compiling Sqoop requires the following tools:

* Apache ant (1.7.1)
* Java JDK 1.6

Additionally, building the documentation requires these tools:

* asciidoc
* make
* python 2.5+
* xmlto
* tar
* gzip

To compile Sqoop, run +ant package+. There will be a fully self-hosted build
provided in the +build/sqoop-(version)/+ directory. 

You can build just the jar by running +ant jar+.

See the COMPILING.txt document for for information.

== This is also an Asciidoc file!

* Try running +asciidoc README.txt+
* For more information about asciidoc, see http://www.methods.co.nz/asciidoc/