5
0
mirror of https://github.com/apache/sqoop.git synced 2025-05-16 17:00:53 +08:00
Commit Graph

715 Commits

Author SHA1 Message Date
Venkat Ranganathan
03fa9c5302 SQOOP-1056: Implement connection resiliency in Sqoop using pluggable failure handlers
SQOOP-1057: Introduce fault injection framework to test connection resiliency

(Shuaishuai Nie via Venkat Ranganathan)
2014-01-31 19:48:52 -08:00
Venkat Ranganathan
ad12695b59 SQOOP-1273: Multiple append jobs can easily end up sharing directories
(Jarek Jarcec Cecho via Venkat Ranganathan)
2014-01-29 11:29:47 -08:00
Jarek Jarcec Cecho
da5ab302e9 SQOOP-1271: Sqoop hcatalog location should support older bigtop default location also
(Venkat Ranganathan via Jarek Jarcec Cecho)
2014-01-23 09:59:08 -08:00
Hari Shreedharan
a1e45de8e9 SQOOP-1226. --password-file option triggers FileSystemClosed exception at end of Oozie action
(Jarek Jarcec Cecho via Hari Shreedharan)
2014-01-16 12:18:05 -08:00
Jarek Jarcec Cecho
c688915e8e SQOOP-1259: Sqoop on Windows can't run HCatalog/HBase multinode jobs
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-12-16 03:18:59 -08:00
Jarek Jarcec Cecho
28f415ff2f SQOOP-1261: CompilationManager should add Hadoop 2.x libraries to the classpath under Hadoop 2.x
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-12-15 13:57:15 -08:00
Jarek Jarcec Cecho
6523ebb176 SQOOP-1249: Sqoop HCatalog Import fails with -queries because of validation issues
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-12-07 10:27:36 -08:00
Venkat Ranganathan
8d3454dc60 SQOOP-1250: Oracle connector is not disabling autoCommit on created connections
(Jarek Jarcec Cecho via Venkat Ranganathan)
2013-12-05 11:07:30 -08:00
Jarek Jarcec Cecho
e98075976b SQOOP-1246: HBaseImportJob should add job authtoken only if HBase is secured
(Aditya Kishore via Jarek Jarcec Cecho)
2013-12-04 10:05:29 -08:00
Jarek Jarcec Cecho
5f7013eae1 SQOOP-767: Add support for Accumulo
(Philip A Grim II via Jarek Jarcec Cecho)
2013-11-20 13:42:23 -08:00
Hari Shreedharan
07cc3b3fad SQOOP-1228. Method Configuration#unset is not available on Hadoop < 1.2.0
(Jarek Jarcec Cecho via Hari Shreedharan)
2013-11-06 10:36:43 -08:00
Jarek Jarcec Cecho
71638a355a SQOOP-1224: Enable use of Oracle Wallets with Oracle Manager
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-11-05 14:19:06 -08:00
Hari Shreedharan
bbc2c17a77 SQOOP-1227. Sqoop fails to compile against commons-io higher then 1.4
(Jarek Jarcec Cecho via Hari Shreedharan)
2013-11-05 12:37:02 -08:00
Hari Shreedharan
ed73f885a1 SQOOP-1223. Enhance the password file capability to enable plugging-in custom loaders.
(Jarek Jarcec Cecho via Hari Shreedharan)
2013-11-05 11:30:08 -08:00
Jarek Jarcec Cecho
a555a1f31a SQOOP-435: Avro import should write the Schema to a file
(James Anderson via Jarek Jarcec Cecho)
2013-10-23 11:59:55 -07:00
Jarek Jarcec Cecho
8407118126 SQOOP-1192: Add option "--skip-dist-cache" to allow Sqoop not copying jars in %SQOOP_HOME%\lib folder when launched by Oozie and use Oozie share lib
(Shuaishuai Nie via Jarek Jarcec Cecho)
2013-10-14 15:31:11 -07:00
Jarek Jarcec Cecho
ddb81e185b SQOOP-1032: Add the --bulk-load-dir option to support the HBase doBulkLoad function
(Alexandre Normand via Jarek Jarcec Cecho)
2013-10-10 16:57:37 -07:00
Jarek Jarcec Cecho
66af31d13c SQOOP-1213: Support reading password files from Amazon S3 2013-10-09 12:01:01 -07:00
Jarek Jarcec Cecho
06183f7aba SQOOP-1167: Enhance HCatalog support to allow direct mode connection manager implementations
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-09-09 08:19:11 -07:00
Arvind Prabhakar
56b5a37284 SQOOP-1190 Class HCatHadoopShims will be removed in HCatalog 0.12
(Jarek Jarcec Cecho via Arvind Prabhakar)
2013-09-04 11:25:07 -07:00
Hari Shreedharan
d9ff9e0734 SQOOP-1132. Print out Sqoop version into log during execution
(Jarek Jarcec Cecho via Hari Shreedharan)
2013-08-30 19:02:41 -07:00
Hari Shreedharan
6c712bacf7 SQOOP-1137. Put a stress in the user guide that eval tool is meant for evaluation purpose only
(Jarek Jarcec Cecho via Hari Shreedharan)
2013-08-30 18:59:15 -07:00
Hari Shreedharan
15ae44016d SQOOP-1107. Further improve error reporting when exporting malformed data
(Jarek Jarcec Cecho via Hari Shreedharan)
2013-08-30 18:54:13 -07:00
Hari Shreedharan
127d2ddec1 SQOOP-1185. LobAvroImportTestCase is sensitive to test method order execution
(Jarek Jarcec Cecho via Hari Shreedharan)
2013-08-30 18:47:47 -07:00
Jarek Jarcec Cecho
1b41c9a6d2 SQOOP-1170: Can't import columns with name "public"
(Erik Selin via Jarek Jarcec Cecho)
2013-08-26 09:00:37 -07:00
Jarek Jarcec Cecho
fa40fcabea SQOOP-1179: Incorrect warning saying --hive-import was not specified when it was specified
(Venkat Ranganathan via Jarek Jarek Cecho)
2013-08-22 12:43:12 -07:00
Jarek Jarcec Cecho
db89861c0c SQOOP-1161: Generated Delimiter Set Field Should be Static
(Nick White via Jarek Jarcec Cecho)
2013-08-15 08:31:38 -07:00
Venkat Ranganathan
5eea9d5997 SQOOP-1140: Enable overriding username, password and database in DB2 test
(Jarek Jarcec Cecho via Venkat Ranganathan)
2013-07-17 10:01:30 -07:00
Jarek Jarcec Cecho
5495113781 SQOOP-906: Sqoop is always calling ConnectionManager.datetimeToQueryString with TIMESTAMP column type
(Raghav Kumar Gautam via Jarek Jarcec Cecho)
2013-07-15 10:34:38 -07:00
Jarek Jarcec Cecho
ab4bfb9a82 SQOOP-1124: Direct export to PostgreSQL with PGBulkloadManager fails without explicit port number settings
(Masatake Iwasaki via Jarek Jarcec Cecho)
2013-07-11 08:34:34 -07:00
Jarek Jarcec Cecho
73cc549d9d SQOOP-1097: Export using procedures feature needs fixes for working with mysql
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-07-09 21:55:27 -07:00
Venkat Ranganathan
00bc001fb9 SQOOP-1129: PostgreSQL direct test are failing on trunk
(Jarek Jarcec Cecho via Venkat Ranganathan)
2013-07-09 20:00:37 -07:00
Jarek Jarcec Cecho
b8fd602028 SQOOP-1118: Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql
(Masatake Iwasaki via Jarek Jarcec Cecho)
2013-07-09 19:45:32 -07:00
Jarek Jarcec Cecho
fb29b8f9fc SQOOP-999: Support bulk load from HDFS to PostgreSQL using COPY ... FROM
(Masatake Iwasaki via Jarek Jarcec Cecho)
2013-07-03 18:38:14 -07:00
Jarek Jarcec Cecho
a2a02076a9 SQOOP-1038: Add support for composite keys in HBase import
(Shruti Joshi via Jarek Jarcec Cecho)
2013-06-21 09:07:24 -07:00
Jarek Jarcec Cecho
217e2af3f8 SQOOP-934: JDBC Connection can timeout after import but before hive import
(Raghav Kumar Gautam via Jarek Jarcec Cecho)
2013-06-20 15:10:36 -07:00
Jarek Jarcec Cecho
92e94b911d SQOOP-1078: incremental import from database in direct mode
(Tim Howe via Jarek Jarcec Cecho)
2013-06-19 15:38:40 -07:00
Jarek Jarcec Cecho
64878c643e SQOOP-1035: Add MS Sqoop Connecter tests
(Shuaishuai Nie via Jarek Jarcec Cecho)
2013-06-18 15:30:24 -07:00
Kate Ting
931da2b126 SQOOP-1083: Split HBaseImportTest into multiple independent tests
(Jarek Jarcec Cecho via Kate Ting)
2013-06-14 15:19:30 -04:00
Jarek Jarcec Cecho
5bfd84e137 SQOOP-883: Remove input directory prior Sqoop import
(Raghav Kumar Gautam via Jarek Jarcec Cecho)
2013-06-12 08:55:50 -07:00
Kate Ting
5d767e796d SQOOP-1071: Avro import is failing when columns are starting with underscore
(Jarek Jarcec Cecho via Kate Ting)
2013-06-10 17:17:28 -04:00
Jarek Jarcec Cecho
658c15848f SQOOP-976: Incorrect SQL when incremental criteria is text column
(Raghav Kumar Gautam via Jarek Jarcec Cecho)
2013-06-09 08:48:33 -07:00
Jarek Jarcec Cecho
5e88d43b5a SQOOP-931: Integrate HCatalog with Sqoop
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-06-07 07:33:21 -07:00
Kate Ting
b07906a2a2 SQOOP-1052: Hive import is not compatible with Avro and SequenceFile but no errors are thrown
(Jarek Jarcec Cecho via Kate Ting)
2013-05-23 18:54:23 -04:00
Jarek Jarcec Cecho
b2d3a682ad SQOOP-1030: Enable column types Binary and Varbinary parsing in Sqoop for export
(Shuaishuai Nie via Jarek Jarcec Cecho)
2013-05-23 01:37:10 -07:00
Jarek Jarcec Cecho
ead68ad37e SQOOP-1053: Fix sqoop to work with Hadoop 2.0.4 alpha
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-05-22 01:11:32 -07:00
Jarek Jarcec Cecho
28af5122ea SQOOP-1031: Provide default Java type mapping for MS Sql Datetimeoffset type
(Shuaishuai Nie via Jarek Jarcec Cecho)
2013-05-20 23:22:04 -07:00
Jarek Jarcec Cecho
e76ee6eea5 SQOOP-1029: Oracle export using procedures does not work
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-05-20 23:09:23 -07:00
Jarek Jarcec Cecho
0bd1e89353 SQOOP-1034: Fix SQL Azure database may return table columns in inconsistent order
(Shuaishuai Nie via Jarek Jarcec Cecho)
2013-05-20 07:44:26 -07:00
Jarek Jarcec Cecho
fd756a0c40 SQOOP-891: Sqoop export from S3 to MySQL fails when S3 is not default filesystem.
(Jurgen Van Gael via Jarek Jarcec Cecho)
2013-05-20 07:27:53 -07:00
Kate Ting
403f0aece2 SQOOP-1027: Incremental import is not properly escaping table name when loading maximal value
(Jarek Jarcec Cecho via Kate Ting)
2013-05-05 03:08:45 -04:00
Kate Ting
aa6813e36d SQOOP-1008: Test TestClassWriter.testNoClassGeneration is failing on JDK7
(Jarek Jarcec Cecho via Kate Ting)
2013-04-23 18:46:47 -04:00
Jarek Jarcec Cecho
7567315de6 SQOOP-988: Validation option should provide some output that validation is being done
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-04-16 09:56:29 -07:00
Jarek Jarcec Cecho
2d3341488f SQOOP-981: The --hadoop-home command line parameter is no longer accepted
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-04-15 10:10:01 -07:00
Jarek Jarcec Cecho
f5006b6005 SQOOP-955: Fix Sqoop unit test failures on Windows
(Ahmed El Baz via Jarek Jarcec Cecho)
2013-04-15 09:57:25 -07:00
Kate Ting
8b3742ad69 SQOOP-912: Add ability to specify --hive-database parameter
(Jarek Jarcec Cecho via Kate Ting)
2013-04-15 12:44:32 -04:00
Jarek Jarcec Cecho
c4b0eac2d0 SQOOP-949: Allow Sqoop to build on Windows OS
(Ahmed El Baz via Jarek Jarcec Cecho)
2013-04-13 11:26:28 -07:00
Kate Ting
00d09b7b25 SQOOP-979: MySQL direct connector is not working correct after moving password to credential cache
(Jarek Jarcec Cecho via Kate Ting)
2013-04-06 17:29:02 -04:00
Jarek Jarcec Cecho
ef093399bf SQOOP-916: Add an abort validation handler
(Venkatesh Seetharam via Jarek Jarcec Cecho)
2013-04-05 11:07:50 -07:00
Jarek Jarcec Cecho
75bc21b164 SQOOP-885: Allow excluding some tables from import-all-tables tools
(Abraham Elmahrek via Jarek Jarcec Cecho)
2013-03-27 17:59:57 -07:00
Jarek Jarcec Cecho
7c830c8186 SQOOP-968: Cannot build when in a directory with spaces
(Abraham Elmahrek via Jarek Jarcec Cecho)
2013-03-25 15:47:59 -07:00
Jarek Jarcec Cecho
7048ca3023 SQOOP-962: Document null string behavior
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-03-21 20:50:26 -07:00
Jarek Jarcec Cecho
a0a03d7f31 SQOOP-932: Netezza direct manager is ignoring --null-*-string arguments
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-03-21 20:23:31 -07:00
Kate
e93ec9f39f SQOOP-959: Use CredentialsUtil.fetchPasswordFromFile in BaseSqoopTool
(Jarek Jarcec Cecho via Kathleen Ting)
2013-03-21 04:27:44 -04:00
Jarek Jarcec Cecho
f2ba7eaae2 SQOOP-937: Dont generate ORM files for Direct mode connectors
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-03-20 14:30:04 -07:00
Jarek Jarcec Cecho
86812b853f SQOOP-914: Securing passwords in sqoop 1.x
(Venkatesh Seetharam via Jarek Jarcec Cecho)
2013-03-20 12:20:38 -07:00
Jarek Jarcec Cecho
b4b9920c4f SQOOP-929: Add more Netezza direct mode tests
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-03-14 22:01:09 -07:00
Abhijeet Gaikwad
05976e709d SQOOP-933: Properly log SQLExceptions using getNextException() method for chaining exceptions
(Jarek Jarcec Cecho via Abhijeet Gaikwad)
2013-03-11 10:30:41 +05:30
Jarek Jarcec Cecho
1d0ebc2730 SQOOP-936: Classwriter should check if columnNames generated are null before accessing them
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-03-09 09:26:06 -08:00
Jarek Jarcec Cecho
0d5f73ad8d SQOOP-846: Provide a connector for Netezza appliances
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-03-04 22:22:46 -08:00
Jarek Jarcec Cecho
34bdf07bc8 SQOOP-928: PostgresqlManager should rollback any pending changes instead of commit when closing connections
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-03-04 19:11:46 -08:00
Cheolsoo Park
f4d5ed5375 SQOOP-907: Print out queries executed by Sqoop on mapreduce job side
(Jarcec Cecho via Cheolsoo Park)
2013-03-01 16:20:10 -08:00
Cheolsoo Park
1d9339d2a4 SQOOP-859: PostgreSQL: Test cases have hard coded username and password
(Jarcec Cecho via Cheolsoo Park)
2013-03-01 16:19:16 -08:00
Jarek Jarcec Cecho
4aa174abee SQOOP-856: PGBulkLoadExportMapper has an infinite waitFor without any logging in the event of Interrupted exceptions
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-02-26 17:24:39 -08:00
Cheolsoo Park
8c3c78b11c SQOOP-901: Allow user to override hardcoded boolean strings in direct PostgreSQL connector
(Jarcec Cecho via Cheolsoo Park)
2013-02-23 19:31:59 -08:00
Jarek Jarcec Cecho
d4d262591c SQOOP-870: Allow Sqoop to import row key column into HBase
(David Robson via Jarek Jarcec Cecho)
2013-02-07 18:48:34 -08:00
Jarek Jarcec Cecho
20b16fd4bd SQOOP-862: Hbase import fails if there is a row where all columns are null
(David Robson via Jarek Jarcec Cecho)
2013-02-07 18:37:50 -08:00
Cheolsoo Park
a220ae4694 SQOOP-654: PostgreSQL direct connector is ignoring --null(-input)string and
--null(-input)-non-string arguments

(Jarek Jarcec Cecho via Cheolsoo Park)
2013-02-06 14:18:23 -08:00
Cheolsoo Park
666d5499a2 SQOOP-860: NullPointerException when running procedure export against old database
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-02-06 14:13:31 -08:00
Jarek Jarcec Cecho
bae5604a3c SQOOP-853: sqoop list-tables isn't returning the tables that have custom schemas'
(Vasanth kumar RJ via Jarek Jarcec Cecho)
2013-02-02 15:09:02 -08:00
Jarek Jarcec Cecho
7c5b46fb28 SQOOP-830: HBase import formatting BigDecimal inconsistently
(David Robson via Jarek Jarcec Cecho)
2013-01-31 09:26:42 -08:00
Cheolsoo Park
0488503a3a SQOOP-855: pg_bulkload: NullPointerException will be thrown if user specified invalid path the binary
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-30 17:10:28 -08:00
Cheolsoo Park
144d31e62a SQOOP-854: Return value of pg_bulkload utility is being ignored
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-30 15:55:26 -08:00
Jarek Jarcec Cecho
9de589e83c SQOOP-840: Inconsistent java generics declaration for exportwriter classes
(Venkat Ranganathan via Jarek Jarcec Cecho)
2013-01-23 09:45:09 -08:00
Jarek Jarcec Cecho
20af67ef60 SQOOP-749: Exports Using Stored Procedures (Functions)
(Nick White via Jarek Jarcec Cecho)
2013-01-22 12:24:40 -08:00
Abhijeet Gaikwad
9a3fd1484f SQOOP-824: Sqoop code generation in 'update' export mode incompatible with '--columns' option
(Jarek Jarcec Cecho via Abhijeet Gaikwad)
2013-01-20 20:56:44 +05:30
Jarek Jarcec Cecho
2b0456d6ce SQOOP-829: Error Messages For --map-column-java Should Be More Useful
(Nick White via Jarek Jarcec Cecho)
2013-01-15 04:15:30 -08:00
Jarek Jarcec Cecho
79f941b7e1 SQOOP-796: Unable to use new Hadoop environment variables
(Sean Mackrory via Jarek Jarcec Cecho)
2013-01-10 09:01:06 -08:00
Cheolsoo Park
fd0143b5ae SQOOP-825: Warning for incorrect usage of hive parameters is not
checking HIVE_HOME correctly

(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-10 08:06:44 -08:00
Cheolsoo Park
fea72de6e6 SQOOP-821: Hadoop has changed logic for job id in LocalJobRunner that
breaks Lob* tests

(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-09 11:36:51 -08:00
Cheolsoo Park
82c117c4f1 SQOOP-818: Missing method setConnManager(Lcom/cloudera/sqoop/manager/ConnManager;)V in
ExportJobContContext breaks MS SQL Connector

(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-08 10:15:35 -08:00
Cheolsoo Park
b02ddc3975 SQOOP-820: Escape table name in export job only if it's required by connector
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-08 10:06:56 -08:00
Jarek Jarcec Cecho
7573450e18 SQOOP-808: SQLExceptions From Batched Exports Aren't Very Helpful
(Nick White via Jarek Jarcec Cecho)
2013-01-06 02:30:15 -08:00
Cheolsoo Park
8029ed0cfc SQOOP-804: Warn if hive special arguments will be used without --hive-import
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-04 02:27:27 -08:00
Jarek Jarcec Cecho
0e8a7dc73e SQOOP-652: Improve error message generated in DataDrivenDBInputFormat when no splitter is available
(Linden Hillenbrand via Jarek Jarcec Cecho)
2012-12-18 20:31:42 -08:00
Cheolsoo Park
52a631f361 SQOOP-731 Move HBase tests to manual tests as they depend on unreleased
artifacts

(Jarek Jarcec Cecho via Cheolsoo Park)
2012-12-08 19:59:57 -08:00
Cheolsoo Park
0c3cd62fca SQOOP-730 User Guide Update: Section 3 - Sqoop Releases
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-12-08 19:48:12 -08:00
Jarek Jarcec Cecho
05774d49be SQOOP-741: The OracleConnect getTables() implementation needs to restrict tables to current user
(Venkat Ranganathan via Jarek Jarcec Cecho)
2012-12-06 08:51:41 -08:00
Jarek Jarcec Cecho
0b465594d2 SQOOP-638: Add an optional, simple and extensible validation framework for sqoop
(Venkatesh Seetharam via Jarek Jarcec Cecho)
2012-12-01 13:00:47 -08:00
Cheolsoo Park
0f0066f525 SQOOP-726: Put debugging information into generated SqoopRecord class
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-11-30 16:24:44 -08:00
Cheolsoo Park
528f7a8bb5 SQOOP-720: Improve error handling when exporting malformed text data
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-11-30 16:13:44 -08:00
Cheolsoo Park
a840f41fc7 SQOOP-721 Duplicating rows on export when exporting from compressed files.
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-11-29 20:40:25 -08:00
Jarek Jarcec Cecho
33a7a81412 SQOOP-725: Enable HBase tests in sqoop 1
(Hari Shreedharan via Jarek Jarcec Cecho)
2012-11-29 08:29:44 -08:00
Cheolsoo Park
dc4a82102c SQOOP-724 Support Table hints in Microsoft SQL Server
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-11-28 14:15:08 -08:00
Cheolsoo Park
b666fe1bb6 SQOOP-706 Sqoop won't compile on Java 7 due to new methods in ResultSet
interface

(Jarek Jarcec Cecho via Cheolsoo Park)
2012-11-28 13:11:51 -08:00
Jarek Jarcec Cecho
817195ebb0 SQOOP-382: Connection parameters should be used on the mapper
(David Robson via Jarek Jarcec Cecho)
2012-11-26 16:26:18 -08:00
Jarek Jarcec Cecho
95098af0e0 SQOOP-657: ant checkstyle results in errors
(Alexander Alten-Lorenz via Jarek Jarcec Cecho)
2012-11-11 15:30:29 -08:00
Jarek Jarcec Cecho
c0a370d57f SQOOP-687: org.apache.sqoop.tool.ExportTool.applyOptions invokes applyOutputFormatOptions(..) twice in succession
(Venkatesh Seetharam via Jarek Jarcec Cecho)
2012-11-10 08:59:56 -08:00
Jarek Jarcec Cecho
da16aa5dc0 SQOOP-683: Documenting sqoop.mysql.export.sleep.ms - easy throttling feature for direct MySQL exports
(Zoltan Toth-Czifra via Jarek Jarcec Cecho)
2012-11-09 09:07:12 -08:00
Cheolsoo Park
ebeb933513 SQOOP-650 Add ability to name mapreduce job generated by Sqoop
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-11-06 16:28:57 -08:00
Abhijeet Gaikwad
c499f49097 SQOOP-604: Easy throttling feature for MySQL exports
(Zoltan Toth-Czifra via Abhijeet Gaikwad)
2012-11-03 10:48:49 +05:30
Jarek Jarcec Cecho
5eb987a785 SQOOP-467: Add support for Oracle BINARY_FLOAT and BINARY_DOUBLE data types
(Cheolsoo Park via Jarek Jarcec Cecho)
2012-11-02 12:16:17 -07:00
Cheolsoo Park
0a30ae174c SQOOP-635 Explaining why it's important to specify weird urandom path in
Troubleshooting guide
2012-10-30 12:12:27 -07:00
Jarek Jarcec Cecho
695666acdb SQOOP-636: ExportJobTestCase.runExport method does not reuse the existing Configuration and SqoopOptions
(Venkatesh Seetharam via Jarek Jarcec Cecho)
2012-10-21 18:22:26 -07:00
Cheolsoo Park
2750df90f9 SQOOP-621 Requesting support for upsert export with MySQL 2012-10-17 20:52:24 -07:00
Jarek Jarcec Cecho
3aed031676 SQOOP-628: Postgres direct import fails on non-lowercase column names
(Paul Butler via Jarek Jarcec Cecho)
2012-10-12 11:01:08 -07:00
Cheolsoo Park
e57ae6aa9e SQOOP-617 User guide is missing argument --fetch-size
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-10-01 18:20:55 -07:00
Cheolsoo Park
4a26d0905c SQOOP-540 Microsoft SQL Connector doesn't support custom schemas
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-10-01 18:17:38 -07:00
Jarek Jarcec Cecho
d4767e9f61 SQOOP-615: Error in Avro generation
(Giovanni Ruggiero via Jarek Jarcec Cecho)
2012-09-27 12:58:35 +02:00
Cheolsoo Park
465c2751f7 SQOOP-616 HBase import/export is not working on non secure cluster where
security is available

(Jarek Jarcec Cecho via Cheolsoo Park)
2012-09-26 14:17:37 -07:00
Cheolsoo Park
5616152ac4 SQOOP-603 Support small intervals in IntegerSplitter implementation
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-09-20 12:14:15 -07:00
Jarek Jarcec Cecho
75f2b707b6 SQOOP-607: In-process Hive CLI driver does not work
(David Robson via Jarek Jarcec Cecho)
2012-09-19 11:02:09 +02:00
Cheolsoo Park
f11c3091c2 SQOOP-601 Support custom schemas in PostgreSQL Connector
(Jarek Jarcec Cecho via Cheolsoo Park)
2012-09-17 11:04:18 -07:00
Abhijeet Gaikwad
0b2a688d36 SQOOP 600: HBase table family presence is not working correctly on new HBase versions
(Jarek Jarcec Cecho via Abhijeet Gaikwad)
2012-09-13 22:46:25 +05:30
Bilung Lee
3fee25eb8f SQOOP-599: Import to HBase is not working on secure cluster 2012-09-11 17:56:56 -07:00
Abhijeet Gaikwad
2a2596b7d5 SQOOP-598. Document NULL substitution string changes for HIVE import.
(Jarek Jarcec Cecho via Abhijeet Gaikwad)
2012-09-10 19:18:58 +05:30
olivier lamy
2c16a25296 [SQOOP-595] Change repository location in source code
Submitted by Jarek Jarcec Cecho.
2012-09-06 10:45:08 +02:00
Jarek Jarcec Cecho
da0b7921a9 SQOOP-437. Preparing release requires manual changes to LICENSE.txt file.
(Abhijeet Gaikwad via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1378831 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 07:30:34 +00:00
Jarek Jarcec Cecho
0d65247f2a SQOOP-586. ant checkstyle has 2 errors.
(Abhijeet Gaikwad via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1376836 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 06:33:00 +00:00
Jarek Jarcec Cecho
1b896f3e46 SQOOP-579. Simple refactoring of org.apache.sqoop.manager.DefaultManagerFactory - extract methods for reuse.
(Seetharam Venkatesh via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1375401 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 07:06:47 +00:00
Jarek Jarcec Cecho
0c396d575b SQOOP-580. Add Open-ended "teardown" routine that is called after the job execution for cleanup.
(Seetharam Venkatesh via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1375399 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 06:56:19 +00:00
Jarek Jarcec Cecho
ec75e134cf SQOOP-582. Create a template method for job submission in Export/Import JobBase.
(Seetharam Venkatesh via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1375395 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 06:43:50 +00:00
Jarek Jarcec Cecho
29b29a52f3 SQOOP-390. PostgreSQL connector for direct export with pg_bulkload.
(Masatake Iwasaki via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1374923 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 06:21:34 +00:00
Jarek Jarcec Cecho
7d775935b6 SQOOP-571. Revert SQOOP-519 and SQOOP-524.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1372828 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 10:23:33 +00:00
Jarek Jarcec Cecho
317562642f Reverting back accidentally committed file.
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1372804 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 09:32:50 +00:00
Jarek Jarcec Cecho
cd0b181fa7 SQOOP-574. Create a Hadoop-2.0.0 build profile.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1372798 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 09:28:59 +00:00
Jarek Jarcec Cecho
7e2df74795 Reverting accidentally commmited file from last commit.
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1371048 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 06:44:48 +00:00
Jarek Jarcec Cecho
9d513408be Preparing for release 1.4.3 development
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1371046 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 06:36:48 +00:00
Jarek Jarcec Cecho
0cef53257f SQOOP-539. getPrimaryKeyQuery is very slow in mysql 5.0.77.
(Jhovanny via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1370124 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 06:12:50 +00:00
Kathleen Ting
be36da3928 SQOOP-410. Direct modes can't import views
(Jarek Jarcec Cecho via Kathlen Ting)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1369390 13f79535-47bb-0310-9956-ffa450edef68
2012-08-04 18:21:44 +00:00
Jarek Jarcec Cecho
02f45c4161 SQOOP-536. Blob import doesn't work with avro 1.7.1.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1369193 13f79535-47bb-0310-9956-ffa450edef68
2012-08-03 20:20:01 +00:00
Bilung Lee
1df2fb6bdf SQOOP-529: Enforce usage of --driver and --connection-manager parameters
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1368748 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 23:05:22 +00:00
Bilung Lee
90d15511d5 SQOOP-528: Remove references to incubator from sources
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1368628 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 18:06:49 +00:00
Jarek Jarcec Cecho
8e0be7cc59 SQOOP-521. Import fails on tables with names containing hyphens ( - ).
(Abhijeet Gaikwad via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1366886 13f79535-47bb-0310-9956-ffa450edef68
2012-07-29 18:27:45 +00:00
Jarek Jarcec Cecho
9eebfb48be SQOOP-519. Update the version of hsqldb decadency to 2.X.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1365691 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 18:33:11 +00:00
Kathleen Ting
a3e578b0cb SQOOP-522. Move printing error "ERROR orm.CompilationManager: Could not rename" to DEBUG
(Jarek Jarcec Cecho via Kathleen Ting)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1365320 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 22:01:03 +00:00
Bilung Lee
90e64cd5ea SQOOP-510 Improve the error message for bad connector files
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1354705 13f79535-47bb-0310-9956-ffa450edef68
2012-06-27 20:12:33 +00:00
Bilung Lee
f6761e6d74 SQOOP-460 Verbose logging does not turn the level for correct logger
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1353677 13f79535-47bb-0310-9956-ffa450edef68
2012-06-25 17:32:32 +00:00
Bilung Lee
6f92225b84 SQOOP-505 Handle trailing space in managers.d/connectors
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1352359 13f79535-47bb-0310-9956-ffa450edef68
2012-06-20 22:41:37 +00:00
Bilung Lee
cf8602eb77 SQOOP-436 Enable verbose logging for MapReduce jobs
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1351503 13f79535-47bb-0310-9956-ffa450edef68
2012-06-18 21:49:42 +00:00
Jarek Jarcec Cecho
78d107f171 SQOOP-503: --columns argument support for export.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1351062 13f79535-47bb-0310-9956-ffa450edef68
2012-06-17 06:49:06 +00:00
Bilung Lee
5f6dd35e8e SQOOP-480 MS SQL server connector is incompatible with Sqoop-1.4
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1347112 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 20:49:36 +00:00
Bilung Lee
0c406e7830 SQOOP-487 Log InformationSchemaManager.getPrimaryKeyQuery invocation
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1345313 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 18:51:58 +00:00
Bilung Lee
67847bd071 SQOOP-476 If table name is a qualified name, Sqoop import fails in DB2
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1345282 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 17:34:27 +00:00
Jarek Jarcec Cecho
5f888fefdd SQOOP-481. Sqoop import with --hive-import using wrong column names in --columns throws a NPE.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1345225 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 15:12:25 +00:00
Jarek Jarcec Cecho
4505205588 SQOOP-489. Cannot define partition keys for Hive tables created through Sqoop.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1344429 13f79535-47bb-0310-9956-ffa450edef68
2012-05-30 19:30:10 +00:00
Jarek Jarcec Cecho
b0de5ca47c SQOOP-490. Style error in the trunk.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1344409 13f79535-47bb-0310-9956-ffa450edef68
2012-05-30 18:46:08 +00:00
Kathleen Ting
e0590385e3 SQOOP-488. Parameter for extended verbose is not working due to migrated code to different module
(Jarek Jarcec Cecho via Kathleen Ting)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1343147 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 06:41:35 +00:00
Jarek Jarcec Cecho
06b636aac6 SQOOP-483. Allow target dir to be set to a different name than table name for hive import.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1342998 13f79535-47bb-0310-9956-ffa450edef68
2012-05-27 06:18:02 +00:00
Kathleen Ting
35365d5e21 SQOOP-484. Update troubleshooting guide section about MySQL and TINYINT(1) columns
(Jarek Jarcec Cecho via Kathleen Ting)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1338034 13f79535-47bb-0310-9956-ffa450edef68
2012-05-14 04:42:54 +00:00
Kathleen Ting
32a9d56ead SQOOP-482. Import tool for mysql direct mode reports wrong
record number
(Nemon Lou via Kathleen Ting)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1336434 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 22:38:55 +00:00
Kathleen Ting
c9c5e98153 SQOOP-443. Calling sqoop with hive import is not working multiple times due
to kept output directory
(Jarek Jarcec Cecho via Kathleen Ting)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1334328 13f79535-47bb-0310-9956-ffa450edef68
2012-05-05 07:25:46 +00:00
Bilung Lee
199d5eb37e SQOOP-445 Wrong query for getListColumnsQuery in PostgresqlManager
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1331245 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 06:42:42 +00:00
Jarek Jarcec Cecho
d3ef140fe8 SQOOP-453. Oozie does not work with Sqoop metastore.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1330263 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 13:13:58 +00:00
Bilung Lee
8a1052cf9c SQOOP-470 Create tests for blob support for Avro import
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1310554 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 19:10:18 +00:00
Bilung Lee
9c539163ca SQOOP-474 Split-by specification incorrectly triggers bounding value query
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1310129 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 23:22:51 +00:00
Jarek Jarcec Cecho
4373a338ba SQOOP-468. Oracle free form queries fail.
(Cheolsoo Park via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1309268 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 06:58:52 +00:00
Bilung Lee
2a27bf28fb SQOOP-473 Sqoop import-all-tables fails with MySQL connector
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1309163 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 21:47:15 +00:00
Bilung Lee
f13e3c7f8b SQOOP-465 BLOB support for Avro import
git-svn-id: https://svn.apache.org/repos/asf/sqoop/trunk@1307132 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 21:57:06 +00:00
Arvind Prabhakar
885248536a SQOOP-464. Warn when user is importing data into /user/hive/warehouse with flag --hive-import.
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1304026 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 20:20:27 +00:00
Jarek Jarcec Cecho
84a25b206a SQOOP-463. Sqoop User Guide's troubleshooting section should explain how to override the column mapping when importing a table from MySQL into Hive.
(Kathleen Ting via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1303911 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 17:35:56 +00:00
Bilung Lee
7975308820 SQOOP-448 boolean fields get nullified during postgres direct import into hive.
(fix a problem in previous patch)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1301118 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 17:50:39 +00:00
Bilung Lee
8fd98dbe1f SQOOP-448 boolean fields get nullified during postgres direct import into hive.
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1300345 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 20:36:32 +00:00
Arvind Prabhakar
b6707bed9f SQOOP-461. Adding Oracle error to troubleshooting section of user guide.
(Kathleen Ting via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1299784 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 18:56:12 +00:00
Bilung Lee
8b39345360 SQOOP-459 Remove redundant steps in compatibility tests: verifyReadback() method
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1299056 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:30:23 +00:00
Arvind Prabhakar
166b12965d SQOOP-352. Export of avro data fails on year values.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1297782 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:01:02 +00:00
Bilung Lee
6bac9903d7 SQOOP-416 Allow code-generation arguments with Avro imports
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1297199 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 19:44:00 +00:00
Kathleen Ting
ae8d1c7674 SQOOP-450. Direct MySQL import can fail when using mysqldump version 5.1.14 or above.
(Arvind Prabhakar via Kathleen Ting)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1295750 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 19:07:51 +00:00
Bilung Lee
d9ff716ee6 SQOOP-444 Support incremental import for free form queries
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1294802 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 19:56:29 +00:00
Bilung Lee
24aa26915c SQOOP-425 Sqoop invokes ResultSet.isLast() which causes Sybase JDBC driver to hang
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1294396 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 23:42:45 +00:00
Jarek Jarcec Cecho
40856655c3 SQOOP-428. AvroOutputFormat doesn't support compression even though documentation claims it does
(Lars Francke via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1240613 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 21:37:08 +00:00
Bilung Lee
4f490b47a3 SQOOP-422. Throw an exception when --direct and hbase* options are used together
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1236903 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 22:01:34 +00:00
Bilung Lee
541bbc8fcf SQOOP-432. Enforce writing space after if statement
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1236496 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 02:38:58 +00:00
Bilung Lee
78e2c2e297 SQOOP-430 Duplicate Column problem with reserved words
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1235970 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 22:13:34 +00:00
Bilung Lee
688f6169fa SQOOP-409 hive-drop-import-delims doesn't work with MySQL direct import
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1232653 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 23:52:22 +00:00
Bilung Lee
334632e929 SQOOP-395 Incorrect or missing SVN property settings
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1230747 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 20:10:26 +00:00
Alex Newman
666fc48609 SQOOP-421. User guide should state that when using --direct, hbase params get ignored
(Jarek Jarcec Cecho via Alex Newman)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1229399 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 22:25:24 +00:00
Jarek Jarcec Cecho
dcf9a82599 SQOOP-411. Precompile Pattern for replacement of Hive delimiters
(Lars Francke via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1226881 13f79535-47bb-0310-9956-ffa450edef68
2012-01-03 17:22:22 +00:00
Jarek Jarcec Cecho
1b50342612 SQOOP-418. MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
(Arvind Prabhakar via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1225123 13f79535-47bb-0310-9956-ffa450edef68
2011-12-28 07:20:55 +00:00
Arvind Prabhakar
dd57ed2e7f SQOOP-413. Port files into Sqoop that are not found in prior versions of Hadoop.
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1221843 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 19:25:52 +00:00
Jarek Jarcec Cecho
57a20d745c SQOOP-412. Create our own implementation of org.apache.hadoop.conf.Configuration.getInstances
(Eric Wadsworth via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1221127 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 07:27:12 +00:00
Arvind Prabhakar
075efe50a0 SQOOP-414. Column name ordering guarantee for OracleManager.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1220973 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 22:12:52 +00:00
Arvind Prabhakar
5cc64097ae SQOOP-405. Enable TestDataDrivenDBInputFormat for Hadoop 0.23
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1213964 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 22:34:32 +00:00
Arvind Prabhakar
6c1ddf5f7c SQOOP-397. Make Sqoop work with Hadoop 0.23
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1211583 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 18:33:08 +00:00
Arvind Prabhakar
c6eca91af0 SQOOP-400. Merge 1.4.0 release changes back to trunk.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1209344 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 03:02:10 +00:00
Jarek Jarcec Cecho
9bde3ec5df SQOOP-392. Build using maven is broken due to missing class generated by script write-version-info.sh
(Arvind Prabhakar via Jarek Jarcec Cecho)



git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1206698 13f79535-47bb-0310-9956-ffa450edef68
2011-11-27 11:12:37 +00:00
Arvind Prabhakar
1bf7cbf81a SQOOP-362. Allow user to override type mapping when doing Avro import.
(Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1205233 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 23:30:10 +00:00
Arvind Prabhakar
f31f577f08 SQOOP-393. Class SqoopOptions was not properly moved.
(Jarek Jarcec via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1203759 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 17:37:03 +00:00
Bilung Lee
b8de0e5026 SQOOP-354 SQOOP needs to be made compatible with Hadoop .23 release
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1199149 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 08:05:02 +00:00
Bilung Lee
5bbc924c81 SQOOP-383 Version tool is not working
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1197390 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 02:15:45 +00:00
Bilung Lee
fc656273d4 SQOOP-373 Can only write to default file system on direct import
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196980 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 07:10:50 +00:00
Bilung Lee
22ed175b76 SQOOP-385 Typo in PostgresqlTest.java regarding configuring postgresql.conf
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196933 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 04:01:18 +00:00
Bilung Lee
d8a8c43009 SQOOP-367 Codegen support for free-form query
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196921 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 02:27:58 +00:00
Arvind Prabhakar
1598c5a481 SQOOP-386. Namespace migration cleanup.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196486 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 07:48:56 +00:00
Bilung Lee
fd844db769 SQOOP-378: Migrate manager package to new name space
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1196272 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 21:01:09 +00:00
Bilung Lee
fb1c2c94c4 SQOOP-381: Migrate cli and config packages to new name space
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195865 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:20:12 +00:00
Bilung Lee
916983e137 SQOOP-364: Default getCurTimestampQuery() in SqlManager is not working for PostgreSQL
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195859 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 07:47:23 +00:00
Bilung Lee
3fcd6c8768 SQOOP-375: Migrate metastore and metastore.hsqldb packages to new name space
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195857 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 07:39:43 +00:00
Bilung Lee
d91085714f SQOOP-374: Migrate tool and orm packages to new name space
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195852 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 07:10:13 +00:00
Arvind Prabhakar
b0b9e69c2f SQOOP-380. Migrate hive and hbase packages to new namespace.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1195674 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 21:15:29 +00:00
Arvind Prabhakar
37831c6125 SQOOP-376. Migrate mapreduce package to new namespace.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1190489 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 18:22:16 +00:00
Bilung Lee
37c9642e7d SQOOP-377 Migrate mapreduce.db package to new name space
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1190441 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 16:50:39 +00:00
Bilung Lee
315fff82b9 SQOOP-379 Migrate lib and io packages to new name space
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1190430 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 16:32:43 +00:00
Arvind Prabhakar
a8cdad50d2 SQOOP-371. Migrate util package to new namespace.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1188921 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 21:19:35 +00:00
Olivier Lamy
90797042ae fix some references Sqoop is now an Apache product :-)
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1187776 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 20:52:54 +00:00
Olivier Lamy
a0296b9b29 remove cloudera google analytics tracker
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1187774 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 20:50:11 +00:00
Olivier Lamy
4a2e8e86e5 source code base is now at ASF
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1187773 13f79535-47bb-0310-9956-ffa450edef68
2011-10-22 20:49:58 +00:00
Bilung Lee
0028a8aebf SQOOP-353 Cleanup the if/else statement in HiveTypes
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1186537 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:18:32 +00:00
Bilung Lee
94b5182efe SQOOP-366 Sqoop User Guide's troubleshooting section should include MySQL setup instructions
(Kate Ting via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1185776 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 18:17:46 +00:00
Bilung Lee
5cf46c24cd SQOOP-361 [Docs] $CONDITIONS must be escaped to not allow shells to replace it.
(Harsh J via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1185449 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 01:28:03 +00:00
Arvind Prabhakar
c39bf2a14e SQOOP-342. Allow user to override Sqoop type mapping.
(Jarek Jarcec Checho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1182523 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 18:54:31 +00:00
Bilung Lee
8e0ce98551 SQOOP-358 Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile
(Chris Tierney via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1182150 13f79535-47bb-0310-9956-ffa450edef68
2011-10-12 00:24:07 +00:00
Bilung Lee
8711e293bd SQOOP-359 Import fails with Unknown SQL datatype exception
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1180279 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 23:42:00 +00:00
Arvind Prabhakar
d6eec1f2d5 SQOOP-357. Debug logs should include chained exception trace.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1180162 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 19:12:01 +00:00
Arvind Prabhakar
fd3634dc3c SQOOP-341. Support for unsigned integers with MySQL.
(Alex Newman via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1178661 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 01:12:13 +00:00
Arvind Prabhakar
7c6b8b3e7d SQOOP-355. Improve Sqoop Documentation for Avro data file support.
(Doug Cutting via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1178574 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 20:55:13 +00:00
Bilung Lee
f4a4fbb304 SQOOP-313: Support for multiple column names for update keys
(Arvind Prabhakar via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1177481 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 01:57:59 +00:00
Arvind Prabhakar
6a7144a496 SQOOP-331. Support for boundary query.
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1176981 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 17:43:11 +00:00
Arvind Prabhakar
028464dd7e SQOOP-351. Notes for troubleshooting section of user guide.
(Kate Ting via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1176952 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 16:44:45 +00:00
Arvind Prabhakar
21040519b0 SQOOP-339. Error handling for mknod failure.
(Joey Echeverria via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1173919 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 00:32:51 +00:00
Bilung Lee
230c687d88 SQOOP-329: SQOOP doesn't work with the DB2 JCC driver
(Arvind Prabhakar via Bilung Lee)

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1173471 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 02:58:31 +00:00
Arvind Prabhakar
cad898768b SQOOP-340. Explicit error message for invalid options.
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1173304 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 18:53:10 +00:00
Arvind Prabhakar
c2c4e24a1f SQOOP-310. Update copyright and License headers.
(Alex Newman via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1171668 13f79535-47bb-0310-9956-ffa450edef68
2011-09-16 17:00:22 +00:00
Arvind Prabhakar
d01117f7b9 SQOOP-336. Avro import does not support varbinary types.
(Tom White via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1170979 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 07:05:25 +00:00
Arvind Prabhakar
4992ce7515 SQOOP-332. Cannot use --as-avrodatafile with --query.
(Joseph Boyd via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1170977 13f79535-47bb-0310-9956-ffa450edef68
2011-09-15 06:55:33 +00:00
Arvind Prabhakar
e1e6e5c009 SQOOP-327. Mixed update/insert export for Oracle.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1166930 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 22:25:39 +00:00
Arvind Prabhakar
7d2939b3a1 SQOOP-323. Support for NVARCHAR datatype.
(Jarek Jarcec Cecho via Bilung Lee)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1165981 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 02:57:56 +00:00
Arvind Prabhakar
0ef6974ce6 SQOOP-330. Descriptive error message when column name cannot be determined.
(Jarek Jarcec Cecho via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1165969 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 02:46:12 +00:00
Arvind Prabhakar
892610c5b7 SQOOP-321. Support date/time for incremental append imports.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1161404 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 06:27:05 +00:00
Arvind Prabhakar
ce5d285397 SQOOP-319. Support for replacing Hive delimiters.
(Joey Echeverria via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1161382 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 04:52:09 +00:00
Arvind Prabhakar
5258c2855f SQOOP-318. Support splittable LZO files with Hive.
(Joey Echeverria via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1160815 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 17:17:08 +00:00
Arvind Prabhakar
d0d057a7cd SQOOP-320. Use Information Schema for SQLServer.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159949 13f79535-47bb-0310-9956-ffa450edef68
2011-08-21 07:33:42 +00:00
Arvind Prabhakar
7dfa96268b SQOOP-314. Support for batch insert.
(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159773 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 20:27:11 +00:00
Arvind Prabhakar
01a029949a SQOOP-317. Allow working with tables owned by other users in Oracle.
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1159491 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 03:14:38 +00:00
Arvind Prabhakar
6c6d37214f SQOOP-316. Added troubleshooting section to user guide.
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1158959 13f79535-47bb-0310-9956-ffa450edef68
2011-08-17 22:51:29 +00:00
Arvind Prabhakar
fe9f6c723a SQOOP-309. Update Sqoop dependency versions.
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1158378 13f79535-47bb-0310-9956-ffa450edef68
2011-08-16 17:07:57 +00:00
Arvind Prabhakar
8d8bcfc53f SQOOP-305. Support export from Avro Data Files.
(Tom White via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1156405 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 23:58:07 +00:00
Olivier Lamy
dfc6fa4e7c SQOOP-310 Review license headers
start working on build/configuration files

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1155235 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 07:10:53 +00:00
Jonathan Hsieh
1ba97009f2 SQOOP-303/150. Use catalog views for PostgressqlManager (Bilung Lee)
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1154386 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 21:36:38 +00:00
Aaron Kimball
1014f4b54a SQOOP-308. Generated Avro Schema cannot handle nullable fields.
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1154059 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 01:01:30 +00:00
Olivier Lamy
1c6ea534b7 mark thoses classes as abstract are they are not intended to be executed as unit test
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153532 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 15:11:36 +00:00
Olivier Lamy
4353f6b8d7 configure surefire plugin to avoid creating temp file on .
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1153054 13f79535-47bb-0310-9956-ffa450edef68
2011-08-02 07:32:03 +00:00
Olivier Lamy
8a9d85391c start working on a maven build : some tests failed due to missing oracle jdbc driver
git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1152974 13f79535-47bb-0310-9956-ffa450edef68
2011-08-02 00:01:38 +00:00
Arvind Prabhakar
e53beb7fbb SQOOP-149. Use catalog views for MySQLManager.
This change enables the use of Information Schema for
MySQLManager.

(Bilung Lee via Arvind Prabhakar)


git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150184 13f79535-47bb-0310-9956-ffa450edef68
2011-07-23 18:51:21 +00:00
Andrew Bayer
76cfa0d7e3 SQOOP-172. Allow passing of connection parameters.
This change introduces a new option that can be used to pass custom
connection parameters while creating JDBC connections. If no connection
parameters are specified, the system defaults to the old behavior.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150051 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:41 +00:00
Andrew Bayer
c640823653 SQOOP-231. Typo in sqoop-import man page.
The Sqoop man page for sqoop-import and sqoop-import-all-tables incorrectly
specified the option for Avro datafile format as ----as-avrodatafile. Instead
it should be --as-avrodatafile. Also included in this change is whitespace
fix for build.xml and an addition to .gitignore.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150050 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:41 +00:00
Andrew Bayer
588d20f949 SQOOP-221. Sqoop Export fails for SQLServer 2005.
This change introduces a new Connection Manager for SQL Server along
with basic test case to exercise part of the functionality. It also
addresses the problem noted in SQOOP-229 by overriding the
getCurTimestampQuery method as suggested.

(Patrick Angeles via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150049 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:41 +00:00
Andrew Bayer
44ffd1e75b SQOOP-207. Support import as Avro Data Files.
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150047 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:40 +00:00
Andrew Bayer
5eaafd3243 SQOOP-225. Checkstyle module for detecting trailing white spaces.
This patch adds a checkstyle module to detect trailing white
spaces. It also removed various current instances of trailing
white spaces in the code.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150046 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:39 +00:00
Andrew Bayer
fe9c0666b9 SQOOP-91. Empty "columns" clause leads to null pointer exception
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150045 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:38 +00:00
Andrew Bayer
bccae3464a SQOOP-224. Table name issue with PostgreSQL.
Recently the PostgresqlManager was updated to escape all identifier
names. This change addresses a couple of places where the identifier
was either not being escaped, or was being lower-case converted as
per the previous logic.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150044 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:38 +00:00
Andrew Bayer
eac50d0e24 SQOOP-212. Hive import for existing table does not work.
This patch fixes a bug that prevents importing data into
an existing hive table with the 'hive-overwrite' argument set.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150043 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:38 +00:00
Andrew Bayer
cb911f34b4 SQOOP-67. NPE when column name list contains spaces
- e.g. sqoop -import --columns "col1, col2"

From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150042 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:37 +00:00
Andrew Bayer
c0ca0c100b SQOOP-219. Duplicate columns arguments results in code generation compilation error
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150041 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:37 +00:00
Andrew Bayer
913034315b SQOOP-48: Import bug when splitting over unsigned bigint column
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150040 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:37 +00:00
Andrew Bayer
b84aaf3ab0 SQOOP-215. Support for codec aliases.
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150039 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:37 +00:00
Andrew Bayer
fe4f54a413 SQOOP-195. Documentation tip on specifying MR job name.
Documentation change to highlight how to use hadoop generic
options to set the MR job name.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150038 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:36 +00:00
Andrew Bayer
0870f9499a SQOOP-158. Additional methods for generated classes.
Adding setter-methods and a field-based equals-implementation to
the generated classes. These new methods enhance the usage of the
generated classes.

(Michael Häusler via ahmed)

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150037 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:36 +00:00
Andrew Bayer
dfd9021662 SQOOP-201. Support for arbitrary compression codec.
(Tom White via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150036 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:36 +00:00
Andrew Bayer
7fa8b68fab SQOOP-206. HBase import to use plugin InputFormat.
(Peter Hall via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150035 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:35 +00:00
Andrew Bayer
6acded9bb9 SQOOP-204. Allow connector specific bounds query.
This change introduces a new method in ConnManager that allows the
various implementations to optionally override it and specify
custom bounds query used for calculating splits during free form
query based imports.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150033 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:35 +00:00
Andrew Bayer
f9f45cf55d SQOOP-205. Add getJob() to JobBase
(Garrett Wu via Aaron Kimball)

From: Aaron Kimball <akimball83@gmail.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150032 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:34 +00:00
Andrew Bayer
0efc5a4d55 SQOOP-100. Sqoop to support populating Hive table partitions.
Initial patch by Frank Maritato.

From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150031 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:34 +00:00
Andrew Bayer
0a795d32e4 SQOOP-193. Update Docs to describe --hive-drop-import-delims argument
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150030 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:34 +00:00
Andrew Bayer
34b7c72165 SQOOP-118. Sqoop should work without HBase where possible.
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150029 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:33 +00:00
Andrew Bayer
f38e40e760 SQOOP-129. Newlines in RDBMS fields break Hive
From: Jonathan Hsieh <jon@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150028 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:33 +00:00
Andrew Bayer
79fd6b4d84 SQOOP-191. Supplying programmatic configuration.
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150027 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:33 +00:00
Andrew Bayer
aa41d0635e SQOOP-192. Limit HSQLDB export to single inserts.
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150026 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:32 +00:00
Andrew Bayer
7677d39b79 SQOOP-187. Allow skipping end-of-record delimiter.
The SqoopRecord.toString() and SqoopRecord.toString(DelimiterSet) methods
always append an end-of-record delimiter. Sqoop uses its own OutputFormat
when rendering these to text files, so that the user's delimiters are
preserved.

Other users could use this OutputFormat when working with SqoopRecord
instances in their own MapReduce code, but it would also be nice to "play
nice" with TextOutputFormat in the event that the intent is
newline-terminated records.

This patch allows users to suppress end-of-record delimiter generation when
formatting records with toString.

(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150025 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:32 +00:00
Andrew Bayer
3bbb4a6314 SQOOP-170. Capturing causal exception for logging.
From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150024 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:32 +00:00
Andrew Bayer
67dce5cc36 SQOOP-185. Tool plugins should not reuse names.
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150023 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:31 +00:00
Andrew Bayer
a8dd09ddbe SQOOP-183. File rename fails for generated files.
(Angus He via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150022 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:31 +00:00
Andrew Bayer
cf117e6500 SQOOP-179. Adding setField() method to SqoopRecord
This change introduces a setField(fieldName, fieldVal) method for
SqoopRecord instances which would allow an arbitrary programmatic
"setter" function without requiring reflection.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150021 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:31 +00:00
Andrew Bayer
5ee493ee0c SQOOP-178. Support for tool plugins.
The change will look for ToolPlugin definitions in the
sqoop.tool.plugins configuration entry, or conf/tools.d. Each
ToolPlugin returns a list of ToolDesc entries, which are then
registered with SqoopTool.register() before the user's arguments
are parsed. The user can then run 'sqoop <custom-tool> args...'
as if it were part of the natural Sqoop system.

(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150020 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:30 +00:00
Andrew Bayer
9db0f3b4a9 SQOOP-181. Improve formatting of help messages.
(Aaron Kimball via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150018 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:30 +00:00
Andrew Bayer
9219504fd8 SQOOP-166. Postgresql identifiers should be quoted
(James Grant via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150017 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:30 +00:00
Andrew Bayer
9b10f9b2c4 SQOOP-168. NPE due to null binary columns.
(Scott Foster via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150016 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:29 +00:00
Andrew Bayer
5774ddd6db SQOOP-165. Improved log message for unknown types.
(Lars Francke via Arvind Prabhakar)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150015 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:29 +00:00
Andrew Bayer
6f2e5c683a SQOOP-162. Changes for vendor-specific subclasses.
Minor changes to AsyncSqlExecThread to use execute instead of executeUpdate
and to DBRecordReader to allow subclasses to access the configuration object.

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150014 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:29 +00:00
Andrew Bayer
a00a320bfa SQOOP-153. Enable tests against real cluster.
From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150013 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:28 +00:00
Andrew Bayer
0b1f47c459 SQOOP-152. Support for test against cluster.
This change allows Sqoop unit tests to be run against a real cluster.

(Konstantin Boudnik via arvind)

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150012 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:28 +00:00
Andrew Bayer
d920b8a0e8 SQOOP-140. Control max. number of fetched records.
This change adds the ability of specifying the max. number of fetched records
from the database. This will solve problems that may arise when importing
large tables.

(Michael Häusler via ahmed)

From: Ahmed Radwan <ahmed@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150011 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:28 +00:00
Andrew Bayer
de2fc6c2b3 SQOOP-164. Allow unit tests to use external dbs.
Modified the thirdparty tests to pick host URL from system properties.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150010 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:27 +00:00
Andrew Bayer
3f8252a28c SQOOP-154. Fix connection leak in OracleManager.
From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150009 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:27 +00:00
Andrew Bayer
49613bb5b7 SQOOP-159. Fixing HBase test failures.
Changes include explicitly setting the Zookeeper client port and increasing
the memory limit from 256m to 512m in build.xml.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150008 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:27 +00:00
Andrew Bayer
4e6351f372 SQOOP-148. Use catalog views for OracleManager.
This change updates the OracleManager to use catalog views for resolving
the necessary metadata.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150006 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:26 +00:00
Andrew Bayer
70caf779b0 SQOOP-142. Document requirements for direct import
Updated the documentation with details on direct mode execution
requirements.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150005 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:26 +00:00
Andrew Bayer
e33bdbced1 SQOOP-111. Documentation fix.
Sqoop user guide inaccurately claims that Hive does not support escaping
of characters. This change updates the user guide to fix this and make the
claim based on the current capabilities of Hive.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150004 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:25 +00:00
Andrew Bayer
fbb283f54d SQOOP-143. Simplify test configuration.
This change removes the test that asserts the presence of a non-default hosts
file configuration. It also adds the necessary comments to the PostgresqlTest
to allow configuring the server for default hosts file configuration.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150003 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:25 +00:00
Andrew Bayer
1d5b7011a9 SQOOP-124. Improve error handling during export.
This change introduces the ability to use a staging table for intermediate
storage during execution for regular export jobs in insert mode. This allows
all of exported data to first be populated in the staging table and then
inserted into the destination table in a single transaction. Thus if a failure
were to occur during export, it is less likely to corrupt the destination
table data. Moreover, the staging table is emptied before the export
job starts populating it, which ensures that re-running the job does not
require any special clean up.

From: Arvind Prabhakar <arvind@cloudera.com>

git-svn-id: https://svn.apache.org/repos/asf/incubator/sqoop/trunk@1150002 13f79535-47bb-0310-9956-ffa450edef68
2011-07-22 20:04:25 +00:00