5
0
mirror of https://github.com/apache/sqoop.git synced 2025-05-02 19:01:27 +08:00
Commit Graph

895 Commits

Author SHA1 Message Date
Andrew Bayer
681461461a MAPREDUCE-1174. Sqoop improperly handles table/column names which are reserved sql words. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149847 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:30 +00:00
Andrew Bayer
8b483c6ded MAPREDUCE-1146. Sqoop dependencies break Eclipse build on Linux. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149846 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:29 +00:00
Andrew Bayer
4686e0fee7 MAPREDUCE-1148. SQL identifiers are a superset of Java identifiers. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149845 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:29 +00:00
Andrew Bayer
12827a1765 MAPREDUCE-1224. Calling "SELECT t.* from <table> AS t" to get meta information is too expensive for big tables. Contributed by Spencer Ho.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149844 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:29 +00:00
Andrew Bayer
8e813b95a4 MAPREDUCE-1168. Export data to databases via Sqoop. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149843 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:28 +00:00
Andrew Bayer
2312eeff5a MAPREDUCE-1239. Fix contrib components build dependencies
From: Giridharan Kesavan <gkesavan@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149842 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:28 +00:00
Andrew Bayer
b451865d53 HADOOP-5107. Use Maven ant tasks to publish artifacts. (Giridharan Kesavan
via omalley)

From: Owen O'Malley <omalley@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149841 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:28 +00:00
Andrew Bayer
ec8f687d97 MAPREDUCE-1169. Improvements to mysqldump use in Sqoop. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149840 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:28 +00:00
Andrew Bayer
84adbeea26 MAPREDUCE-1037. Continue running contrib tests if Sqoop tests fail. Contributed by Aaron Kimball
From: Christopher Douglas <cdouglas@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149839 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:27 +00:00
Andrew Bayer
a0229d9738 MAPREDUCE-1036. Document Sqoop API. Contributed by Aaron Kimball
From: Christopher Douglas <cdouglas@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149838 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:27 +00:00
Andrew Bayer
9afc7a8aee MAPREDUCE-1069. Implement Sqoop API refactoring. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149837 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:27 +00:00
Andrew Bayer
93dab4998e MAPREDUCE-1017. Compression and output splitting for Sqoop. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149836 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:26 +00:00
Andrew Bayer
8dcc748853 MAPREDUCE-947. Added commitJob and abortJob apis to OutputCommitter. Enhanced FileOutputCommitter to create a _SUCCESS file for successful jobs. Contributed by Amar Kamat & Jothi Padmanabhan.
From: Arun Murthy <acmurthy@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149835 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:26 +00:00
Andrew Bayer
4b193ec488 MAPREDUCE-906. Update Sqoop documentation. Contributed by Aaron Kimball
From: Christopher Douglas <cdouglas@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149834 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:26 +00:00
Andrew Bayer
4a689cf491 MAPREDUCE-999. Improve Sqoop test speed and refactor tests. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149833 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:26 +00:00
Andrew Bayer
940db9f6ce MAPREDUCE-980. Modify JobHistory to use Avro for serialization.
From: Douglass Cutting <cutting@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149832 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:25 +00:00
Andrew Bayer
fd4f25baa4 MAPREDUCE-923. Sqoop classpath breaks for jar files with a plus sign in their names. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149831 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:25 +00:00
Andrew Bayer
7e3284691d MAPREDUCE-849. Rename configuration properties. Contributed by Amareshwari Sriramadasu.
From: Sharad Agarwal <sharad@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149830 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:25 +00:00
Andrew Bayer
8071445237 MAPREDUCE-777. Brand new apis to track and query jobs as a replacement for JobClient. Contributed by Amareshwari Sriramadasu.
From: Arun Murthy <acmurthy@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149829 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:25 +00:00
Andrew Bayer
37cadedc8f MAPREDUCE-907. Sqoop should use more intelligent splits. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149828 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:24 +00:00
Andrew Bayer
629559c3fb MAPREDUCE-157. Refactor job history APIs and change the history format to JSON. Contributed by Jothi Padmanabhan.
From: Sharad Agarwal <sharad@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149827 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:24 +00:00
Andrew Bayer
b34b2acc10 MAPREDUCE-938. Postgresql support for Sqoop. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149826 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:24 +00:00
Andrew Bayer
2bbf349f4c MAPREDUCE-918. Test hsqldb server should be memory-only. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149825 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:24 +00:00
Andrew Bayer
9e8955ede1 MAPREDUCE-876. Sqoop import of large tables can time out. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149824 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:23 +00:00
Andrew Bayer
89241b591a MAPREDUCE-750. Extensible ConnManager factory API. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149823 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:23 +00:00
Andrew Bayer
e7cf0ed69c MAPREDUCE-749. Make Sqoop unit tests more Hudson-friendly. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149822 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:23 +00:00
Andrew Bayer
a87e225891 MAPREDUCE-877. Added avro as a dependency to contrib ivy settings. Contributed by Tsz Wo (Nicholas) Sze.
From: Hemanth Yamijala <yhemanth@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149821 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:23 +00:00
Andrew Bayer
6cf87c5147 MAPREDUCE-789. Oracle support for Sqoop. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149820 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:23 +00:00
Andrew Bayer
ecbb765019 MAPREDUCE-816. Rename "local" mysql import to "direct" in Sqoop. (Aaron Kimball via matei).
From: Matei Alexandru Zaharia <matei@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149819 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:22 +00:00
Andrew Bayer
3d39962dfa MAPREDUCE-705. User-configurable quote and delimiter characters for Sqoop records and record reparsing. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149818 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:22 +00:00
Andrew Bayer
3c322c9969 MAPREDUCE-710. Sqoop should read and transmit passwords in a more secure manner. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149817 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:22 +00:00
Andrew Bayer
120e06f0a0 MAPREDUCE-713. Sqoop has some superfluous imports. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149816 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:21 +00:00
Andrew Bayer
595bf13670 MAPREDUCE-685. Sqoop will fail with OutOfMemory on large tables using mysql. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149815 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:21 +00:00
Andrew Bayer
d427bca2de MAPREDUCE-675. Sqoop should allow user-defined class and package names. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149814 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:21 +00:00
Andrew Bayer
9dfc7ba898 MAPREDUCE-674. Sqoop should allow a "where" clause to avoid having to export entire tables. Contributed by Kevin Weil.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149813 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:21 +00:00
Andrew Bayer
8b7bde6f35 MAPREDUCE-703. Sqoop requires dependency on hsqldb in ivy.
Contributed by Aaron Kimball.

From: Matei Alexandru Zaharia <matei@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149812 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:20 +00:00
Andrew Bayer
3a67d2a1f4 MAPREDUCE-690. Sqoop's test "hive" script needs to be executable. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149811 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:20 +00:00
Andrew Bayer
6f44c87140 MAPREDUCE-673. Sqoop depends on commons-cli, which is not in its ivy.xml. Contributed by Kevin Weil.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149810 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:20 +00:00
Andrew Bayer
fad03388cf HADOOP-5968. Sqoop should only print a warning about mysql import speed once. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149809 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:20 +00:00
Andrew Bayer
5e04507108 HADOOP-5967. Sqoop should only use a single map task. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149808 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:20 +00:00
Andrew Bayer
dc191132a5 HADOOP-5887. Sqoop should create tables in Hive metastore after importing to HDFS. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149807 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:20 +00:00
Andrew Bayer
bf65299ba1 HADOOP-5844. Use mysqldump when connecting to local mysql instance in Sqoop. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149806 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:19 +00:00
Andrew Bayer
c58670cbdb HADOOP-5815. Sqoop: A database import tool for Hadoop. Contributed by Aaron Kimball.
From: Thomas White <tomwhite@apache.org>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149805 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:03:19 +00:00
Andrew Bayer
07d1892f66 Placeholder commit
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1149804 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 19:59:57 +00:00
Olivier Lamy
f64403d28d svn trunk layout
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1135508 13f79535-47bb-0310-9956-ffa450edef68
2011-06-14 12:07:16 +00:00