github/sqoop
5
0
Fork 0
mirror of https://github.com/apache/sqoop.git synced 2025-05-11 06:20:43 +08:00
Code Issues Projects Releases Wiki Activity
298 Commits 21 Branches 30 Tags 24 MiB
c39bf2a14e
Commit Graph

191 Commits

Author SHA1 Message Date
Arvind Prabhakar
c39bf2a14e SQOOP-342. Allow user to override Sqoop type mapping. 
(Jarek Jarcec Checho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1182523 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 18:54:31 +00:00
Bilung Lee
8e0ce98551 SQOOP-358 Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile 
(Chris Tierney via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1182150 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 00:24:07 +00:00
Bilung Lee
8711e293bd SQOOP-359 Import fails with Unknown SQL datatype exception 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1180279 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 23:42:00 +00:00
Arvind Prabhakar
d6eec1f2d5 SQOOP-357. Debug logs should include chained exception trace. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1180162 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 19:12:01 +00:00
Arvind Prabhakar
fd3634dc3c SQOOP-341. Support for unsigned integers with MySQL. 
(Alex Newman via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1178661 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 01:12:13 +00:00
Bilung Lee
f4a4fbb304 SQOOP-313: Support for multiple column names for update keys 
(Arvind Prabhakar via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1177481 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 01:57:59 +00:00
Arvind Prabhakar
6a7144a496 SQOOP-331. Support for boundary query. 
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1176981 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 17:43:11 +00:00
Arvind Prabhakar
21040519b0 SQOOP-339. Error handling for mknod failure. 
(Joey Echeverria via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1173919 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-22 00:32:51 +00:00
Bilung Lee
230c687d88 SQOOP-329: SQOOP doesn't work with the DB2 JCC driver 
(Arvind Prabhakar via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1173471 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 02:58:31 +00:00
Arvind Prabhakar
cad898768b SQOOP-340. Explicit error message for invalid options. 
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1173304 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-20 18:53:10 +00:00
Arvind Prabhakar
c2c4e24a1f SQOOP-310. Update copyright and License headers. 
(Alex Newman via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1171668 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 17:00:22 +00:00
Arvind Prabhakar
d01117f7b9 SQOOP-336. Avro import does not support varbinary types. 
(Tom White via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1170979 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 07:05:25 +00:00
Arvind Prabhakar
4992ce7515 SQOOP-332. Cannot use --as-avrodatafile with --query. 
(Joseph Boyd via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1170977 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 06:55:33 +00:00
Arvind Prabhakar
e1e6e5c009 SQOOP-327. Mixed update/insert export for Oracle. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1166930 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 22:25:39 +00:00
Arvind Prabhakar
7d2939b3a1 SQOOP-323. Support for NVARCHAR datatype. 
(Jarek Jarcec Cecho via Bilung Lee)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1165981 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 02:57:56 +00:00
Arvind Prabhakar
0ef6974ce6 SQOOP-330. Descriptive error message when column name cannot be determined. 
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1165969 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 02:46:12 +00:00
Arvind Prabhakar
892610c5b7 SQOOP-321. Support date/time for incremental append imports. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1161404 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 06:27:05 +00:00
Arvind Prabhakar
ce5d285397 SQOOP-319. Support for replacing Hive delimiters. 
(Joey Echeverria via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1161382 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 04:52:09 +00:00
Arvind Prabhakar
5258c2855f SQOOP-318. Support splittable LZO files with Hive. 
(Joey Echeverria via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1160815 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-23 17:17:08 +00:00
Arvind Prabhakar
d0d057a7cd SQOOP-320. Use Information Schema for SQLServer. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159949 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-21 07:33:42 +00:00
Arvind Prabhakar
7dfa96268b SQOOP-314. Support for batch insert. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159773 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 20:27:11 +00:00
Arvind Prabhakar
01a029949a SQOOP-317. Allow working with tables owned by other users in Oracle. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159491 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 03:14:38 +00:00
Arvind Prabhakar
fe9f6c723a SQOOP-309. Update Sqoop dependency versions. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1158378 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-16 17:07:57 +00:00
Arvind Prabhakar
8d8bcfc53f SQOOP-305. Support export from Avro Data Files. 
(Tom White via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1156405 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 23:58:07 +00:00
Jonathan Hsieh
1ba97009f2 SQOOP-303/150. Use catalog views for PostgressqlManager (Bilung Lee) 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1154386 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 21:36:38 +00:00
Aaron Kimball
1014f4b54a SQOOP-308. Generated Avro Schema cannot handle nullable fields. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1154059 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 01:01:30 +00:00
Olivier Lamy
4353f6b8d7 configure surefire plugin to avoid creating temp file on . 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153054 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 07:32:03 +00:00
Olivier Lamy
8a9d85391c start working on a maven build : some tests failed due to missing oracle jdbc driver 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1152974 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 00:01:38 +00:00
Arvind Prabhakar
e53beb7fbb SQOOP-149. Use catalog views for MySQLManager. 
This change enables the use of Information Schema for
MySQLManager.

(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150184 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-23 18:51:21 +00:00
Andrew Bayer
76cfa0d7e3 SQOOP-172. Allow passing of connection parameters. 
This change introduces a new option that can be used to pass custom
connection parameters while creating JDBC connections. If no connection
parameters are specified, the system defaults to the old behavior.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150051 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:41 +00:00
Andrew Bayer
588d20f949 SQOOP-221. Sqoop Export fails for SQLServer 2005. 
This change introduces a new Connection Manager for SQL Server along
with basic test case to exercise part of the functionality. It also
addresses the problem noted in SQOOP-229 by overriding the
getCurTimestampQuery method as suggested.

(Patrick Angeles via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150049 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:41 +00:00
Andrew Bayer
44ffd1e75b SQOOP-207. Support import as Avro Data Files. 
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150047 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:40 +00:00
Andrew Bayer
5eaafd3243 SQOOP-225. Checkstyle module for detecting trailing white spaces. 
This patch adds a checkstyle module to detect trailing white
spaces. It also removed various current instances of trailing
white spaces in the code.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150046 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:39 +00:00
Andrew Bayer
fe9c0666b9 SQOOP-91. Empty "columns" clause leads to null pointer exception 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150045 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:38 +00:00
Andrew Bayer
bccae3464a SQOOP-224. Table name issue with PostgreSQL. 
Recently the PostgresqlManager was updated to escape all identifier
names. This change addresses a couple of places where the identifier
was either not being escaped, or was being lower-case converted as
per the previous logic.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150044 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:38 +00:00
Andrew Bayer
eac50d0e24 SQOOP-212. Hive import for existing table does not work. 
This patch fixes a bug that prevents importing data into
an existing hive table with the 'hive-overwrite' argument set.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150043 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:38 +00:00
Andrew Bayer
cb911f34b4 SQOOP-67. NPE when column name list contains spaces 
- e.g. sqoop -import --columns "col1, col2"

From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150042 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
c0ca0c100b SQOOP-219. Duplicate columns arguments results in code generation compilation error 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150041 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
913034315b SQOOP-48: Import bug when splitting over unsigned bigint column 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150040 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
b84aaf3ab0 SQOOP-215. Support for codec aliases. 
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150039 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
0870f9499a SQOOP-158. Additional methods for generated classes. 
Adding setter-methods and a field-based equals-implementation to
the generated classes. These new methods enhance the usage of the
generated classes.

(Michael Häusler via ahmed)

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150037 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:36 +00:00
Andrew Bayer
dfd9021662 SQOOP-201. Support for arbitrary compression codec. 
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150036 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:36 +00:00
Andrew Bayer
7fa8b68fab SQOOP-206. HBase import to use plugin InputFormat. 
(Peter Hall via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150035 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:35 +00:00
Andrew Bayer
6acded9bb9 SQOOP-204. Allow connector specific bounds query. 
This change introduces a new method in ConnManager that allows the
various implementations to optionally override it and specify
custom bounds query used for calculating splits during free form
query based imports.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150033 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:35 +00:00
Andrew Bayer
f9f45cf55d SQOOP-205. Add getJob() to JobBase 
(Garrett Wu via Aaron Kimball)

From: Aaron Kimball <akimball83@gmail.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150032 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:34 +00:00
Andrew Bayer
0efc5a4d55 SQOOP-100. Sqoop to support populating Hive table partitions. 
Initial patch by Frank Maritato.

From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150031 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:34 +00:00
Andrew Bayer
34b7c72165 SQOOP-118. Sqoop should work without HBase where possible. 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150029 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:33 +00:00
Andrew Bayer
f38e40e760 SQOOP-129. Newlines in RDBMS fields break Hive 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150028 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:33 +00:00
Andrew Bayer
79fd6b4d84 SQOOP-191. Supplying programmatic configuration. 
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150027 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:33 +00:00
Andrew Bayer
aa41d0635e SQOOP-192. Limit HSQLDB export to single inserts. 
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150026 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:32 +00:00