github/sqoop
5
0
Fork 0
mirror of https://github.com/apache/sqoop.git synced 2025-05-07 13:51:24 +08:00
Code Issues Projects Releases Wiki Activity
671 Commits 21 Branches 30 Tags 24 MiB
fca329b326
Commit Graph

671 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arvind Prabhakar
01a029949a SQOOP-317. Allow working with tables owned by other users in Oracle. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159491 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 03:14:38 +00:00
Arvind Prabhakar
6c6d37214f SQOOP-316. Added troubleshooting section to user guide. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1158959 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-17 22:51:29 +00:00
Arvind Prabhakar
fe9f6c723a SQOOP-309. Update Sqoop dependency versions. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1158378 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-16 17:07:57 +00:00
Olivier Lamy
fb3aa233bd SQOOP-315 updgrade avro to 1.5.2 
upgrade in pom.xml too

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1157961 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-15 19:34:22 +00:00
Olivier Lamy
d7f374f7f8 ignore target directory 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1157960 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-15 19:34:11 +00:00
Arvind Prabhakar
09b0d12133 SQOOP-315. Updated Avro version to 1.5.2. 
(Tom White via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1157938 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-15 18:30:20 +00:00
Arvind Prabhakar
8d8bcfc53f SQOOP-305. Support export from Avro Data Files. 
(Tom White via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1156405 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 23:58:07 +00:00
Olivier Lamy
dfc6fa4e7c SQOOP-310 Review license headers 
start working on build/configuration files

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1155235 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-09 07:10:53 +00:00
Olivier Lamy
7004515445 ignore idea files 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1155234 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-09 07:10:33 +00:00
Jonathan Hsieh
1ba97009f2 SQOOP-303/150. Use catalog views for PostgressqlManager (Bilung Lee) 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1154386 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 21:36:38 +00:00
Aaron Kimball
1014f4b54a SQOOP-308. Generated Avro Schema cannot handle nullable fields. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1154059 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 01:01:30 +00:00
Olivier Lamy
a0d34feeaa fix hbase tests 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153555 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 16:00:51 +00:00
Olivier Lamy
1c6ea534b7 mark thoses classes as abstract are they are not intended to be executed as unit test 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153532 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 15:11:36 +00:00
Olivier Lamy
8ff48c50db setup hive.home sysprops for running tests 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153528 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 15:01:17 +00:00
Olivier Lamy
a30befd24f fix slf4j versions for test to not be dependant about possible various versions due to transitive maven resolution 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153512 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 14:39:38 +00:00
Olivier Lamy
ea0ae3e264 exclude/include some tests in various profiles : oracle,mysql... 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153508 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 14:37:02 +00:00
Olivier Lamy
4353f6b8d7 configure surefire plugin to avoid creating temp file on . 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153054 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 07:32:03 +00:00
Olivier Lamy
8a9d85391c start working on a maven build : some tests failed due to missing oracle jdbc driver 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1152974 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-02 00:01:38 +00:00
Olivier Lamy
4defccc6b1 ignore idea files 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1152956 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 22:26:51 +00:00
Arvind Prabhakar
05d5cf249b Added DISCLAIMER.txt, some svn:ignore entries and removed the empty placeholder 
file introduced for code-import.


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1151690 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-28 00:25:07 +00:00
Arvind Prabhakar
e53beb7fbb SQOOP-149. Use catalog views for MySQLManager. 
This change enables the use of Information Schema for
MySQLManager.

(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150184 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-23 18:51:21 +00:00
Arvind Prabhakar
512400b1ec Adding svn:ignore properties. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150174 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-23 17:34:47 +00:00
Andrew Bayer
76cfa0d7e3 SQOOP-172. Allow passing of connection parameters. 
This change introduces a new option that can be used to pass custom
connection parameters while creating JDBC connections. If no connection
parameters are specified, the system defaults to the old behavior.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150051 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:41 +00:00
Andrew Bayer
c640823653 SQOOP-231. Typo in sqoop-import man page. 
The Sqoop man page for sqoop-import and sqoop-import-all-tables incorrectly
specified the option for Avro datafile format as ----as-avrodatafile. Instead
it should be --as-avrodatafile. Also included in this change is whitespace
fix for build.xml and an addition to .gitignore.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150050 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:41 +00:00
Andrew Bayer
588d20f949 SQOOP-221. Sqoop Export fails for SQLServer 2005. 
This change introduces a new Connection Manager for SQL Server along
with basic test case to exercise part of the functionality. It also
addresses the problem noted in SQOOP-229 by overriding the
getCurTimestampQuery method as suggested.

(Patrick Angeles via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150049 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:41 +00:00
Andrew Bayer
0361e71969 Increment version and prev.git.hash after branching for release. 
From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150048 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:40 +00:00
Andrew Bayer
44ffd1e75b SQOOP-207. Support import as Avro Data Files. 
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150047 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:40 +00:00
Andrew Bayer
5eaafd3243 SQOOP-225. Checkstyle module for detecting trailing white spaces. 
This patch adds a checkstyle module to detect trailing white
spaces. It also removed various current instances of trailing
white spaces in the code.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150046 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:39 +00:00
Andrew Bayer
fe9c0666b9 SQOOP-91. Empty "columns" clause leads to null pointer exception 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150045 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:38 +00:00
Andrew Bayer
bccae3464a SQOOP-224. Table name issue with PostgreSQL. 
Recently the PostgresqlManager was updated to escape all identifier
names. This change addresses a couple of places where the identifier
was either not being escaped, or was being lower-case converted as
per the previous logic.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150044 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:38 +00:00
Andrew Bayer
eac50d0e24 SQOOP-212. Hive import for existing table does not work. 
This patch fixes a bug that prevents importing data into
an existing hive table with the 'hive-overwrite' argument set.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150043 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:38 +00:00
Andrew Bayer
cb911f34b4 SQOOP-67. NPE when column name list contains spaces 
- e.g. sqoop -import --columns "col1, col2"

From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150042 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
c0ca0c100b SQOOP-219. Duplicate columns arguments results in code generation compilation error 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150041 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
913034315b SQOOP-48: Import bug when splitting over unsigned bigint column 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150040 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
b84aaf3ab0 SQOOP-215. Support for codec aliases. 
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150039 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:37 +00:00
Andrew Bayer
fe4f54a413 SQOOP-195. Documentation tip on specifying MR job name. 
Documentation change to highlight how to use hadoop generic
options to set the MR job name.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150038 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:36 +00:00
Andrew Bayer
0870f9499a SQOOP-158. Additional methods for generated classes. 
Adding setter-methods and a field-based equals-implementation to
the generated classes. These new methods enhance the usage of the
generated classes.

(Michael Häusler via ahmed)

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150037 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:36 +00:00
Andrew Bayer
dfd9021662 SQOOP-201. Support for arbitrary compression codec. 
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150036 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:36 +00:00
Andrew Bayer
7fa8b68fab SQOOP-206. HBase import to use plugin InputFormat. 
(Peter Hall via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150035 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:35 +00:00
Andrew Bayer
da297a784b SQOOP-202. sqoop-metastore should be able to handle missing pid files 
Signed-off-by: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150034 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:35 +00:00
Andrew Bayer
6acded9bb9 SQOOP-204. Allow connector specific bounds query. 
This change introduces a new method in ConnManager that allows the
various implementations to optionally override it and specify
custom bounds query used for calculating splits during free form
query based imports.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150033 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:35 +00:00
Andrew Bayer
f9f45cf55d SQOOP-205. Add getJob() to JobBase 
(Garrett Wu via Aaron Kimball)

From: Aaron Kimball <akimball83@gmail.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150032 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:34 +00:00
Andrew Bayer
0efc5a4d55 SQOOP-100. Sqoop to support populating Hive table partitions. 
Initial patch by Frank Maritato.

From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150031 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:34 +00:00
Andrew Bayer
0a795d32e4 SQOOP-193. Update Docs to describe --hive-drop-import-delims argument 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150030 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:34 +00:00
Andrew Bayer
34b7c72165 SQOOP-118. Sqoop should work without HBase where possible. 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150029 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:33 +00:00
Andrew Bayer
f38e40e760 SQOOP-129. Newlines in RDBMS fields break Hive 
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150028 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:33 +00:00
Andrew Bayer
79fd6b4d84 SQOOP-191. Supplying programmatic configuration. 
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150027 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:33 +00:00
Andrew Bayer
aa41d0635e SQOOP-192. Limit HSQLDB export to single inserts. 
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150026 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:32 +00:00
Andrew Bayer
7677d39b79 SQOOP-187. Allow skipping end-of-record delimiter. 
The SqoopRecord.toString() and SqoopRecord.toString(DelimiterSet) methods
always append an end-of-record delimiter. Sqoop uses its own OutputFormat
when rendering these to text files, so that the user's delimiters are
preserved.

Other users could use this OutputFormat when working with SqoopRecord
instances in their own MapReduce code, but it would also be nice to "play
nice" with TextOutputFormat in the event that the intent is
newline-terminated records.

This patch allows users to suppress end-of-record delimiter generation when
formatting records with toString.

(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150025 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:32 +00:00
Andrew Bayer
3bbb4a6314 SQOOP-170. Capturing causal exception for logging. 
From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150024 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-22 20:04:32 +00:00