5
0
mirror of https://github.com/apache/sqoop.git synced 2025-05-03 02:51:00 +08:00
Commit Graph

921 Commits

Author SHA1 Message Date
Attila Szabo
6905415332 SQOOP-3157: Improve regex introduced in [SQOOP-3152] thus not causing
column mapping and AVRO issues

(Attila Szabo)
2017-03-20 21:40:49 +01:00
Attila Szabo
e280b47eac SQOOP-3123: Introduce escaping logic for column mapping parameters (same
what Sqoop already uses for the DB column names), thus special column
names (e.g. containing '#' character) and mappings realted to those
columns can be in the same format (thus not confusing the end users), and
also eliminates the related AVRO format clashing issues.

(Dmitry Zagorulkin via Attila Szabo)
2017-03-20 17:25:29 +01:00
Attila Szabo
803edc2792 SQOOP-3152: Fix SqoopOptions#parseColumnMapping, thus Sqoop will support
mappings with precisison (e.g. DECIMAL(10,5)) in the future properly

(Eric Lin via Attila Szabo)
2017-03-20 16:37:49 +01:00
Attila Szabo
6d8a670d32 SQOOP-3105: Add cleanup logic for PostgreSQL related test cases
(Boglarka Egyed via Attila Szabo)
2017-03-18 10:56:29 +01:00
Anna Szonyi
ac5ca7c021 SQOOP-3143: Restore fail messages removed in SQOOP-3091
(Boglarka Egyed via Anna Szonyi)
2017-03-16 20:23:57 +01:00
Attila Szabo
1a8fe23d7a SQOOP-3142: Restore fail messages removed in SQOOP-3092
(Boglarka Egyed via Attila Szabo)
2017-03-16 17:22:18 +01:00
Attila Szabo
281a87aed2 SQOOP-3100: Clean up expected exception logic in tests - part III.
(Boglarka Egyed via Attila Szabo)
2017-03-14 12:38:18 +01:00
Attila Szabo
a5ae802388 Revert "SQOOP-3100: Clean up expected exception logic in tests - part III."
This reverts commit 150843b264.

I've mistakenly committed the previous change with incorrect author
information, and would not like to break any toolchain by rewriting the
history, thus I'm reverting this, and committing again the change with
proper header information

(Attila Szabo)
2017-03-14 12:36:30 +01:00
maugli
150843b264 SQOOP-3100: Clean up expected exception logic in tests - part III.
(Boglarka Egyed via Attila Szabo)
2017-03-14 12:25:32 +01:00
Attila Szabo
a4ee235243 SQOOP-3141: Fix Java7 compile issue (getTypeName is only available after
Java 8)

(Attila Szabo)
2017-02-24 16:37:47 +01:00
Attila Szabo
5ccef5fd76 SQOOP-1904: Add support for DB2 XML data type (import use case)
(Ying Cao via Attila Szabo)
2017-02-24 09:44:12 +01:00
Attila Szabo
2b70666b04 SQOOP-3140: Removing deprecated mapred.map.max.attempts,
mapred.reduce.max.attempts entries and using the new constants directly from
Hadoop instead

(Anna Szonyi via Attila Szabo)
2017-02-24 07:53:08 +01:00
Attila Szabo
0bb039a002 SQOOP-3135: Improve error message of Sqoop in case of missing password
by adding the related ParseException stack trace

(Eric Lin via Attila Szabo)
2017-02-24 07:45:39 +01:00
Attila Szabo
9466a0c7d9 SQOOP-3136: Add support to Sqoop being able to handle different file
system urls (e.g. s3a://some-bucket/tmp/sqoop)

(Illya Yalovyy via Attila Szabo)
2017-02-24 07:40:48 +01:00
Venkat Ranganathan
d8c4b3ccdd SQOOP-3138: Netezza Direct Import does not support --columns options
(Suraj Nayak  via Venkat Ranganathan)
2017-02-23 08:06:16 -08:00
Attila Szabo
24d08185c5 SQOOP-3061: Improve query validation in connection with --options-file
thus correct options/queries like "--query SELECT * FROM test WHERE a = 'b'"
will not fail with "Malformed option in options file" error message

(Eric Lin via Attila Szabo)
2017-02-15 09:30:16 +01:00
Attila Szabo
98c5ccb80f SQOOP-3127: Increase timeout in TestClassWriter#testWideTableClassGeneration to
avoid flaky test scenarios in the upstream Jenkins

(Attila Szabo)
2017-01-25 00:46:08 +01:00
Attila Szabo
d0f99c01c7 SQOOP-3124: Fix ordering in column list query of
PostgreSQL connector to reflect the logical order
instead of adhoc ordering

(Szabolcs Vasas via Attila Szabo)
2017-01-17 16:30:04 +01:00
Attila Szabo
4a74b8bced SQOOP-3099: Remove all junit3 TestCase extension
and test suites

(Anna Szonyi via Attila Szabo)
2017-01-11 17:35:46 +01:00
Attila Szabo
c0b9bc4353 SQOOP-3068: Enhance error (tool.ImportTool:
Encountered IOException running import job:
java.io.IOException: Expected schema)
to suggest workaround (--map-column-java)

(Szabolcs Vasas via Attila Szabo)
2017-01-11 12:50:28 +01:00
Attila Szabo
d006bc7515 SQOOP-3092: Clean up expected exception logic in
tests - Part II

(Boglarka Egyed via Attila Szabo)
2017-01-11 12:12:05 +01:00
Attila Szabo
7c091a3313 SQOOP-3091: Clean up expected exception logic in
tests - Part I

(Boglarka Egyed via Attila Szabo)
2017-01-11 12:11:25 +01:00
Attila Szabo
0bd850396e SQOOP-3080: Fix comment for default metadata
transaction isolation level

(Attila Szabo)
2016-12-20 11:43:17 +01:00
Attila Szabo
d1e6c5f52f SQOOP-3081: use OracleEscapeUtils.escapeIdentifier
in OracleUpsertOutputFormat instead of inline
appending quotes

(Anna Szonyi via Attila Szabo)
2016-12-16 12:29:09 +01:00
Attila Szabo
bde0ed1e74 SQOOP-3084: Fix fault injection classpath elements
in aop.xml (required by the changes of SQOOP-3051)

(Anna Szonyi via Attila Szabo)
2016-12-16 12:04:05 +01:00
Attila Szabo
7783f85f80 SQOOP-3083: Fixing fault injection targets to work
together with try with resources statements
(introduced in SQOOP-2983)

(Anna Szonyi via Attila Szabo)
2016-12-16 11:59:22 +01:00
Attila Szabo
be30a344ee SQOOP-3075: Simplify Unicode character support in
source files (introduced by SQOOP-3074) by
defining explicit locales instead of using
EscapeUtils

(Attila Szabo)
2016-12-16 11:48:52 +01:00
Attila Szabo
5771a2da5f SQOOP-3074: Fix Avro import not to fail with Javac
errors in case of non UTF-8 locale

(Attila Szabo)
2016-12-08 23:07:31 +01:00
Attila Szabo
44e05df215 SQOOP-3051:Remove all old profiles, configurations
from build.xml and ivy.xml and consolidate them
to a single working one

(Anna Szonyi via Attila Szabo)
2016-12-08 13:24:52 +01:00
Attila Szabo
642b41a9e8 SQOOP-3072: Reenable escaping in
ImportTest#testProductWithWhiteSpaceImport for proper execution

(Attila Szabo)
2016-12-06 17:54:52 +01:00
Attila Szabo
fe67a0a5c0 SQOOP-3071: Fix OracleManager to apply localTimeZone correctly in case of Date objects too
(Attila Szabo)
2016-12-06 17:53:31 +01:00
Attila Szabo
bd51d987b8 SQOOP-3069: Get OracleExportTest#testUpsertTestExport in line with SQOOP-3066
(Attila Szabo)
2016-12-06 13:52:01 +01:00
Attila Szabo
3e5bab49ea SQOOP-3066: Introduce an option + env variable to
enable/disable SQOOP-2737 feature

(Attila Szabo)
2016-12-05 20:25:50 +01:00
Attila Szabo
c3ac21f716 SQOOP-2925: Modify ivy settings to work from the
local ivy cache, thus making ant compile much faster
2016-12-02 21:43:15 +01:00
Attila Szabo
0e26d92a34 SQOOP-3053: Create a cmd line argument for
sqoop.throwOnError and use it through SqoopOptions

(Boglarka Egyed via Attila Szabo)
2016-12-02 15:34:50 +01:00
Attila Szabo
916cae19f8 SQOOP-3057: Fixing 3rd party Oracle tests failing
due to invalid case of column names

(Anna Szonyi via Attila Szabo)
2016-11-29 19:06:19 +01:00
Attila Szabo
f9d76fd4a3 SQOOP-3056: Add ant ivy report target
(Anna Szonyi via Attila Szabo)
2016-11-29 15:38:35 +01:00
Attila Szabo
48cecdc99e SQOOP-3055: Fixing MySQL tests failing due to
ignored test inputs/configuration

(Anna Szonyi via Attila Szabo)
2016-11-29 15:33:16 +01:00
Attila Szabo
b0b7b4779c SQOOP-2349: Add command line option for setting
transaction isolation levels for metadata queries
2016-11-23 21:45:03 +01:00
Attila Szabo
3fba26419b SQOOP-3027: Create fail fast for export with --hcatalog-table <HIVE_VIEW>, as it's not supported by HCat
(Anna Szonyi via Attila Szabo)
2016-11-23 11:39:49 +01:00
Attila Szabo
c08c194eb9 SQOOP-3028: Include stack trace in the logging of exceptions in ExportTool
(Boglarka Egyed via Attila Szabo)
2016-11-22 11:59:16 +01:00
Venkat Ranganathan
7d6667ddb6 SQOOP-2990: Sqoop(oracle) export [updateTableToOracle] with "--update-mode allowinsert" : app fails with java.sql.SQLException: Missing IN or OUT parameter at index
(Sowmya Ramesh via Venkat Ranganathan)
2016-11-11 14:06:21 -08:00
Attila Szabo
68f76982a0 SQOOP-3037: Minor convenience feature - add flag to ant test to enable remote debugging
(Anna Szonyi via Attila Szabo)
2016-11-10 15:19:04 +01:00
Attila Szabo
8e50060849 SQOOP-3013: Configuration "tmpjars" is not checked for empty strings before passing to MR
(Erzsebet Szilagyi via Attila Szabo)
2016-11-10 15:00:19 +01:00
Attila Szabo
64fd3d2d32 SQOOP-3038: export to table with "value" column causes all null values in the "value" column
(Anna Szonyi via Attila Szabo)
2016-11-08 19:10:00 +01:00
Attila Szabo
c3e868ce90 SQOOP-3044: Add missing ASF license information to .java files
(Anna Szonyi via Attila Szabo)
2016-11-08 18:30:13 +01:00
Attila Szabo
53b490e146 SQOOP-3034: HBase import should fail fast if using anything other than as-textfile
(Boglarka Egyed via Attila Szabo)
2016-11-08 18:23:52 +01:00
Venkat Ranganathan
b60aef1ffb SQOOP-3033: Sqoop option --skip-dist-cache is not saved as a parameter when saving Sqoop Job
(Sowmya Ramesh via Venkat Ranganathan)
2016-10-28 20:39:10 -07:00
Jarek Jarcec Cecho
3fc4ff7144 SQOOP-2983: OraOop export has degraded performance with wide tables
(Attila Szabo via Jarek Jarcec Cecho)
2016-10-26 12:20:17 -07:00
Attila Szabo
14754342d3 SQOOP-2986: Add validation check for --hive-import and --incremental lastmodified
(Szabolcs Vasas via Attila Szabo)
2016-10-13 15:21:56 +02:00