github/sqoop
5
0
Fork 0
mirror of https://github.com/apache/sqoop.git synced 2025-05-17 09:20:43 +08:00
Code Issues Projects Releases Wiki Activity
398 Commits 21 Branches 30 Tags 24 MiB
a3e578b0cb
Commit Graph

320 Commits

Author SHA1 Message Date
Jarek Jarcec Cecho
9bde3ec5df SQOOP-392. Build using maven is broken due to missing class generated by script write-version-info.sh 
(Arvind Prabhakar via Jarek Jarcec Cecho)



git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1206698 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-27 11:12:37 +00:00
Arvind Prabhakar
1bf7cbf81a SQOOP-362. Allow user to override type mapping when doing Avro import. 
(Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1205233 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 23:30:10 +00:00
Arvind Prabhakar
f31f577f08 SQOOP-393. Class SqoopOptions was not properly moved. 
(Jarek Jarcec via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1203759 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 17:37:03 +00:00
Bilung Lee
b8de0e5026 SQOOP-354 SQOOP needs to be made compatible with Hadoop .23 release 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1199149 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 08:05:02 +00:00
Bilung Lee
5bbc924c81 SQOOP-383 Version tool is not working 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1197390 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-04 02:15:45 +00:00
Bilung Lee
fc656273d4 SQOOP-373 Can only write to default file system on direct import 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196980 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 07:10:50 +00:00
Bilung Lee
22ed175b76 SQOOP-385 Typo in PostgresqlTest.java regarding configuring postgresql.conf 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196933 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 04:01:18 +00:00
Bilung Lee
d8a8c43009 SQOOP-367 Codegen support for free-form query 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196921 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 02:27:58 +00:00
Arvind Prabhakar
1598c5a481 SQOOP-386. Namespace migration cleanup. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196486 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 07:48:56 +00:00
Bilung Lee
fd844db769 SQOOP-378: Migrate manager package to new name space 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196272 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 21:01:09 +00:00
Bilung Lee
fb1c2c94c4 SQOOP-381: Migrate cli and config packages to new name space 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195865 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:20:12 +00:00
Bilung Lee
916983e137 SQOOP-364: Default getCurTimestampQuery() in SqlManager is not working for PostgreSQL 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195859 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 07:47:23 +00:00
Bilung Lee
3fcd6c8768 SQOOP-375: Migrate metastore and metastore.hsqldb packages to new name space 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195857 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 07:39:43 +00:00
Bilung Lee
d91085714f SQOOP-374: Migrate tool and orm packages to new name space 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195852 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 07:10:13 +00:00
Arvind Prabhakar
b0b9e69c2f SQOOP-380. Migrate hive and hbase packages to new namespace. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195674 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 21:15:29 +00:00
Arvind Prabhakar
37831c6125 SQOOP-376. Migrate mapreduce package to new namespace. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1190489 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 18:22:16 +00:00
Bilung Lee
37c9642e7d SQOOP-377 Migrate mapreduce.db package to new name space 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1190441 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 16:50:39 +00:00
Bilung Lee
315fff82b9 SQOOP-379 Migrate lib and io packages to new name space 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1190430 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 16:32:43 +00:00
Arvind Prabhakar
a8cdad50d2 SQOOP-371. Migrate util package to new namespace. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1188921 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 21:19:35 +00:00
Olivier Lamy
90797042ae fix some references Sqoop is now an Apache product :-) 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1187776 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 20:52:54 +00:00
Olivier Lamy
a0296b9b29 remove cloudera google analytics tracker 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1187774 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 20:50:11 +00:00
Olivier Lamy
4a2e8e86e5 source code base is now at ASF 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1187773 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 20:49:58 +00:00
Bilung Lee
0028a8aebf SQOOP-353 Cleanup the if/else statement in HiveTypes 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1186537 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:18:32 +00:00
Bilung Lee
94b5182efe SQOOP-366 Sqoop User Guide's troubleshooting section should include MySQL setup instructions 
(Kate Ting via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1185776 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 18:17:46 +00:00
Bilung Lee
5cf46c24cd SQOOP-361 [Docs] $CONDITIONS must be escaped to not allow shells to replace it. 
(Harsh J via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1185449 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 01:28:03 +00:00
Arvind Prabhakar
c39bf2a14e SQOOP-342. Allow user to override Sqoop type mapping. 
(Jarek Jarcec Checho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1182523 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 18:54:31 +00:00
Bilung Lee
8e0ce98551 SQOOP-358 Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile 
(Chris Tierney via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1182150 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 00:24:07 +00:00
Bilung Lee
8711e293bd SQOOP-359 Import fails with Unknown SQL datatype exception 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1180279 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 23:42:00 +00:00
Arvind Prabhakar
d6eec1f2d5 SQOOP-357. Debug logs should include chained exception trace. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1180162 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 19:12:01 +00:00
Arvind Prabhakar
fd3634dc3c SQOOP-341. Support for unsigned integers with MySQL. 
(Alex Newman via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1178661 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 01:12:13 +00:00
Arvind Prabhakar
7c6b8b3e7d SQOOP-355. Improve Sqoop Documentation for Avro data file support. 
(Doug Cutting via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1178574 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 20:55:13 +00:00
Bilung Lee
f4a4fbb304 SQOOP-313: Support for multiple column names for update keys 
(Arvind Prabhakar via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1177481 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 01:57:59 +00:00
Arvind Prabhakar
6a7144a496 SQOOP-331. Support for boundary query. 
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1176981 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 17:43:11 +00:00
Arvind Prabhakar
028464dd7e SQOOP-351. Notes for troubleshooting section of user guide. 
(Kate Ting via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1176952 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 16:44:45 +00:00
Arvind Prabhakar
21040519b0 SQOOP-339. Error handling for mknod failure. 
(Joey Echeverria via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1173919 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-22 00:32:51 +00:00
Bilung Lee
230c687d88 SQOOP-329: SQOOP doesn't work with the DB2 JCC driver 
(Arvind Prabhakar via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1173471 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 02:58:31 +00:00
Arvind Prabhakar
cad898768b SQOOP-340. Explicit error message for invalid options. 
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1173304 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-20 18:53:10 +00:00
Arvind Prabhakar
c2c4e24a1f SQOOP-310. Update copyright and License headers. 
(Alex Newman via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1171668 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-16 17:00:22 +00:00
Arvind Prabhakar
d01117f7b9 SQOOP-336. Avro import does not support varbinary types. 
(Tom White via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1170979 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 07:05:25 +00:00
Arvind Prabhakar
4992ce7515 SQOOP-332. Cannot use --as-avrodatafile with --query. 
(Joseph Boyd via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1170977 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-15 06:55:33 +00:00
Arvind Prabhakar
e1e6e5c009 SQOOP-327. Mixed update/insert export for Oracle. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1166930 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 22:25:39 +00:00
Arvind Prabhakar
7d2939b3a1 SQOOP-323. Support for NVARCHAR datatype. 
(Jarek Jarcec Cecho via Bilung Lee)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1165981 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 02:57:56 +00:00
Arvind Prabhakar
0ef6974ce6 SQOOP-330. Descriptive error message when column name cannot be determined. 
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1165969 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 02:46:12 +00:00
Arvind Prabhakar
892610c5b7 SQOOP-321. Support date/time for incremental append imports. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1161404 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 06:27:05 +00:00
Arvind Prabhakar
ce5d285397 SQOOP-319. Support for replacing Hive delimiters. 
(Joey Echeverria via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1161382 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 04:52:09 +00:00
Arvind Prabhakar
5258c2855f SQOOP-318. Support splittable LZO files with Hive. 
(Joey Echeverria via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1160815 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-23 17:17:08 +00:00
Arvind Prabhakar
d0d057a7cd SQOOP-320. Use Information Schema for SQLServer. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159949 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-21 07:33:42 +00:00
Arvind Prabhakar
7dfa96268b SQOOP-314. Support for batch insert. 
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159773 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 20:27:11 +00:00
Arvind Prabhakar
01a029949a SQOOP-317. Allow working with tables owned by other users in Oracle. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159491 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 03:14:38 +00:00
Arvind Prabhakar
6c6d37214f SQOOP-316. Added troubleshooting section to user guide. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1158959 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-17 22:51:29 +00:00
Arvind Prabhakar
fe9f6c723a SQOOP-309. Update Sqoop dependency versions. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1158378 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-16 17:07:57 +00:00
Arvind Prabhakar
8d8bcfc53f SQOOP-305. Support export from Avro Data Files. 
(Tom White via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1156405 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 23:58:07 +00:00
Olivier Lamy
dfc6fa4e7c SQOOP-310 Review license headers 
start working on build/configuration files

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1155235 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-09 07:10:53 +00:00
Jonathan Hsieh
1ba97009f2 SQOOP-303/150. Use catalog views for PostgressqlManager (Bilung Lee) 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1154386 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 21:36:38 +00:00
Aaron Kimball
1014f4b54a SQOOP-308. Generated Avro Schema cannot handle nullable fields. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1154059 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 01:01:30 +00:00
Olivier Lamy
1c6ea534b7 mark thoses classes as abstract are they are not intended to be executed as unit test 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153532 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 15:11:36 +00:00
Olivier Lamy
4353f6b8d7 configure surefire plugin to avoid creating temp file on . 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153054 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 07:32:03 +00:00
Olivier Lamy
8a9d85391c start working on a maven build : some tests failed due to missing oracle jdbc driver 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1152974 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 00:01:38 +00:00
Arvind Prabhakar
e53beb7fbb SQOOP-149. Use catalog views for MySQLManager. 
This change enables the use of Information Schema for
MySQLManager.

(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150184 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-23 18:51:21 +00:00
Andrew Bayer
76cfa0d7e3 SQOOP-172. Allow passing of connection parameters. 
This change introduces a new option that can be used to pass custom
connection parameters while creating JDBC connections. If no connection
parameters are specified, the system defaults to the old behavior.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150051 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:41 +00:00
Andrew Bayer
c640823653 SQOOP-231. Typo in sqoop-import man page. 
The Sqoop man page for sqoop-import and sqoop-import-all-tables incorrectly
specified the option for Avro datafile format as ----as-avrodatafile. Instead
it should be --as-avrodatafile. Also included in this change is whitespace
fix for build.xml and an addition to .gitignore.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150050 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:41 +00:00
Andrew Bayer
588d20f949 SQOOP-221. Sqoop Export fails for SQLServer 2005. 
This change introduces a new Connection Manager for SQL Server along
with basic test case to exercise part of the functionality. It also
addresses the problem noted in SQOOP-229 by overriding the
getCurTimestampQuery method as suggested.

(Patrick Angeles via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150049 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:41 +00:00
Andrew Bayer
44ffd1e75b SQOOP-207. Support import as Avro Data Files. 
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150047 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:40 +00:00
Andrew Bayer
5eaafd3243 SQOOP-225. Checkstyle module for detecting trailing white spaces. 
This patch adds a checkstyle module to detect trailing white
spaces. It also removed various current instances of trailing
white spaces in the code.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150046 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:39 +00:00
Andrew Bayer
fe9c0666b9 SQOOP-91. Empty "columns" clause leads to null pointer exception 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150045 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:38 +00:00
Andrew Bayer
bccae3464a SQOOP-224. Table name issue with PostgreSQL. 
Recently the PostgresqlManager was updated to escape all identifier
names. This change addresses a couple of places where the identifier
was either not being escaped, or was being lower-case converted as
per the previous logic.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150044 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:38 +00:00
Andrew Bayer
eac50d0e24 SQOOP-212. Hive import for existing table does not work. 
This patch fixes a bug that prevents importing data into
an existing hive table with the 'hive-overwrite' argument set.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150043 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:38 +00:00
Andrew Bayer
cb911f34b4 SQOOP-67. NPE when column name list contains spaces 
- e.g. sqoop -import --columns "col1, col2"

From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150042 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
c0ca0c100b SQOOP-219. Duplicate columns arguments results in code generation compilation error 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150041 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
913034315b SQOOP-48: Import bug when splitting over unsigned bigint column 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150040 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
b84aaf3ab0 SQOOP-215. Support for codec aliases. 
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150039 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
fe4f54a413 SQOOP-195. Documentation tip on specifying MR job name. 
Documentation change to highlight how to use hadoop generic
options to set the MR job name.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150038 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:36 +00:00
Andrew Bayer
0870f9499a SQOOP-158. Additional methods for generated classes. 
Adding setter-methods and a field-based equals-implementation to
the generated classes. These new methods enhance the usage of the
generated classes.

(Michael Häusler via ahmed)

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150037 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:36 +00:00
Andrew Bayer
dfd9021662 SQOOP-201. Support for arbitrary compression codec. 
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150036 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:36 +00:00
Andrew Bayer
7fa8b68fab SQOOP-206. HBase import to use plugin InputFormat. 
(Peter Hall via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150035 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:35 +00:00
Andrew Bayer
6acded9bb9 SQOOP-204. Allow connector specific bounds query. 
This change introduces a new method in ConnManager that allows the
various implementations to optionally override it and specify
custom bounds query used for calculating splits during free form
query based imports.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150033 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:35 +00:00
Andrew Bayer
f9f45cf55d SQOOP-205. Add getJob() to JobBase 
(Garrett Wu via Aaron Kimball)

From: Aaron Kimball <akimball83@gmail.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150032 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:34 +00:00
Andrew Bayer
0efc5a4d55 SQOOP-100. Sqoop to support populating Hive table partitions. 
Initial patch by Frank Maritato.

From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150031 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:34 +00:00
Andrew Bayer
0a795d32e4 SQOOP-193. Update Docs to describe --hive-drop-import-delims argument 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150030 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:34 +00:00
Andrew Bayer
34b7c72165 SQOOP-118. Sqoop should work without HBase where possible. 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150029 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:33 +00:00
Andrew Bayer
f38e40e760 SQOOP-129. Newlines in RDBMS fields break Hive 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150028 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:33 +00:00
Andrew Bayer
79fd6b4d84 SQOOP-191. Supplying programmatic configuration. 
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150027 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:33 +00:00
Andrew Bayer
aa41d0635e SQOOP-192. Limit HSQLDB export to single inserts. 
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150026 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:32 +00:00
Andrew Bayer
7677d39b79 SQOOP-187. Allow skipping end-of-record delimiter. 
The SqoopRecord.toString() and SqoopRecord.toString(DelimiterSet) methods
always append an end-of-record delimiter. Sqoop uses its own OutputFormat
when rendering these to text files, so that the user's delimiters are
preserved.

Other users could use this OutputFormat when working with SqoopRecord
instances in their own MapReduce code, but it would also be nice to "play
nice" with TextOutputFormat in the event that the intent is
newline-terminated records.

This patch allows users to suppress end-of-record delimiter generation when
formatting records with toString.

(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150025 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:32 +00:00
Andrew Bayer
3bbb4a6314 SQOOP-170. Capturing causal exception for logging. 
From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150024 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:32 +00:00
Andrew Bayer
67dce5cc36 SQOOP-185. Tool plugins should not reuse names. 
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150023 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:31 +00:00
Andrew Bayer
a8dd09ddbe SQOOP-183. File rename fails for generated files. 
(Angus He via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150022 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:31 +00:00
Andrew Bayer
cf117e6500 SQOOP-179. Adding setField() method to SqoopRecord 
This change introduces a setField(fieldName, fieldVal) method for
SqoopRecord instances which would allow an arbitrary programmatic
"setter" function without requiring reflection.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150021 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:31 +00:00
Andrew Bayer
5ee493ee0c SQOOP-178. Support for tool plugins. 
The change will look for ToolPlugin definitions in the
sqoop.tool.plugins configuration entry, or conf/tools.d. Each
ToolPlugin returns a list of ToolDesc entries, which are then
registered with SqoopTool.register() before the user's arguments
are parsed. The user can then run 'sqoop <custom-tool> args...'
as if it were part of the natural Sqoop system.

(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150020 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:30 +00:00
Andrew Bayer
9db0f3b4a9 SQOOP-181. Improve formatting of help messages. 
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150018 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:30 +00:00
Andrew Bayer
9219504fd8 SQOOP-166. Postgresql identifiers should be quoted 
(James Grant via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150017 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:30 +00:00
Andrew Bayer
9b10f9b2c4 SQOOP-168. NPE due to null binary columns. 
(Scott Foster via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150016 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:29 +00:00
Andrew Bayer
5774ddd6db SQOOP-165. Improved log message for unknown types. 
(Lars Francke via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150015 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:29 +00:00
Andrew Bayer
6f2e5c683a SQOOP-162. Changes for vendor-specific subclasses. 
Minor changes to AsyncSqlExecThread to use execute instead of executeUpdate
and to DBRecordReader to allow subclasses to access the configuration object.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150014 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:29 +00:00
Andrew Bayer
a00a320bfa SQOOP-153. Enable tests against real cluster. 
From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150013 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:28 +00:00
Andrew Bayer
0b1f47c459 SQOOP-152. Support for test against cluster. 
This change allows Sqoop unit tests to be run against a real cluster.

(Konstantin Boudnik via arvind)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150012 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:28 +00:00
Andrew Bayer
d920b8a0e8 SQOOP-140. Control max. number of fetched records. 
This change adds the ability of specifying the max. number of fetched records
from the database. This will solve problems that may arise when importing
large tables.

(Michael Häusler via ahmed)

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150011 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:28 +00:00
Andrew Bayer
de2fc6c2b3 SQOOP-164. Allow unit tests to use external dbs. 
Modified the thirdparty tests to pick host URL from system properties.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150010 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:27 +00:00
Andrew Bayer
3f8252a28c SQOOP-154. Fix connection leak in OracleManager. 
From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150009 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:27 +00:00
Andrew Bayer
49613bb5b7 SQOOP-159. Fixing HBase test failures. 
Changes include explicitly setting the Zookeeper client port and increasing
the memory limit from 256m to 512m in build.xml.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150008 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:27 +00:00