github/sqoop
5
0
Fork 0
mirror of https://github.com/apache/sqoop.git synced 2025-05-21 11:21:39 +08:00
Code Issues Projects Releases Wiki Activity
721 Commits 21 Branches 30 Tags 24 MiB
42d84a84e4
Commit Graph

180 Commits

Author SHA1 Message Date
Jarek Jarcec Cecho
4527916766 SQOOP-1882: JobManager currently ignores the TO connector IDF and assumed all IDF use String for the generic T 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-14 12:39:41 -08:00
Jarek Jarcec Cecho
b35d7573da SQOOP-1872: IDF API should expose a method to add dependent jars 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-13 14:29:15 -08:00
Jarek Jarcec Cecho
a78adb468a SQOOP-1893: add license header to TestSqoopIDFUtils 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-13 11:39:35 -08:00
Abraham Elmahrek
293e9ef636 SQOOP-1813: Sqoop2: Add SqoopIDFUtils class and unit tests 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-12 20:27:09 -06:00
Jarek Jarcec Cecho
dda5e1edd3 SQOOP-1885: Sqoop2: KafkaConnector pom.xml needs license header 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-12-12 09:58:10 -08:00
Abraham Elmahrek
1fc6589221 SQOOP-1825: Sqoop2: Handle NULLs for all types in CSV Intermediate Data Format 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-12 11:52:26 -06:00
Abraham Elmahrek
e2e5aa8bf5 SQOOP-1852: Sqoop2: Kafka connector supporting TO direction 
(Gwen Shapira via Abraham Elmahrek)
 2014-12-11 17:53:48 -06:00
Venkat Ranganathan
c820aaf870 SQOOP-1678: Sqoop2: [HDFS Connector] Configurable null values 
(Abraham Elmahrek via Venkat Ranganathan)
 2014-12-10 20:50:15 -08:00
Jarek Jarcec Cecho
486af80f45 SQOOP-1811: Sqoop2: Change IDF *TextData to *CSVTextData 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-10 10:28:27 -08:00
Abraham Elmahrek
fdc0469505 SQOOP-1845: Sqoop2: Make DateTime Column type support datetime with and without timezone 
(Veena Basavaraj via Abraham ELmahrek)
 2014-12-08 17:13:09 -06:00
Abraham Elmahrek
d38e239b90 SQOOP-1846: Sqoop2: Update CSVIntermediateFormat DateTime tests to use modified ISO-8601 format 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-05 16:52:04 -08:00
Abraham Elmahrek
c865aefea6 SQOOP-1817: Sqoop2: Update CSVIntermediate BIT data type 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-05 15:57:39 -08:00
Abraham Elmahrek
c19f9c9460 SQOOP-1765: Sqoop2: Time/Timestamp format support for CSV IDF 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-04 13:21:50 -08:00
Abraham Elmahrek
ae31a02372 SQOOP-1815: Sqoop2: Date and DateTime is not encoded in Single Quotes 
Also includes unit tests.

(Veena Basavaraj via Abraham Elmahrek)
 2014-12-03 23:48:34 -08:00
Abraham Elmahrek
1675c512ad SQOOP-1843: Sqoop2: Fix timestamp type casting 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-03 18:30:34 -08:00
Jarek Jarcec Cecho
1f4b7fd291 SQOOP-1830: GenericJdBcExtractor does not create java date objects when extracting 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-03 10:34:48 -08:00
Jarek Jarcec Cecho
38f2894ed6 SQOOP-1819: Support Enum in CSVIDF ( + add unit tests) 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-01 17:38:53 -08:00
Jarek Jarcec Cecho
d68c05d3ad SQOOP-1750: Support Map Type in CSV IDF 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-01 15:24:02 -08:00
Jarek Jarcec Cecho
34d7066c38 SQOOP-1749: Support List Type in CSV IDF 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-11-29 07:35:03 -08:00
Abraham Elmahrek
6ea427f9fe SQOOP-1806: Sqoop2: Remove the duplicate connector-config.properties file in Kite connector 
(Qian Xu via Abraham Elmahrek)
 2014-11-26 02:15:21 -08:00
Abraham Elmahrek
6991ff2fb4 SQOOP-1789: Sqoop2: Add validation for partition column when using query based import 
(Jarek Jarcec Cecho via Abraham Elmahrek)
 2014-11-24 14:05:28 -08:00
Jarek Jarcec Cecho
abd12fa544 SQOOP-1754: Sqoop2: Remove JarUtil class 
(Qian Xu via Jarek Jarcec Cecho)
 2014-11-19 09:13:05 -08:00
Jarek Jarcec Cecho
37a5552bab SQOOP-1752: Kite Connector should submit jars for CSV job 
(Qian Xu via Jarek Jarcec Cecho)
 2014-11-18 09:24:56 -08:00
Abraham Elmahrek
59ffd88025 SQOOP-1588: Sqoop2: TO-side: Write data to HDFS 
(Qian Xu via Abraham Elmahrek)
 2014-11-17 22:03:17 -08:00
Jarek Jarcec Cecho
af8571b644 SQOOP-1731: Sqoop2: Generic JDBC upgrade from 1.99.3 to 1.99.4 
(Abraham Elmahre via Jarek Jarcec Cecho)
 2014-11-14 06:27:00 -08:00
Jarek Jarcec Cecho
0ace9710eb SQOOP-1715: Make name for column required ( fix the corr tests) 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-11-12 22:28:08 -08:00
Abraham Elmahrek
3edf9cad6f SQOOP-1621: Sqoop2: Allow null as a dummy Schema 
(Veena Basavaraj via Abraham Elmahrek)
 2014-11-12 20:15:45 -08:00
Jarek Jarcec Cecho
4fd8dec145 SQOOP-1708: Rename Unsupported Column type to Unknown and add java doc 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-11-10 22:13:05 -08:00
Abraham Elmahrek
fe5d615bf1 SQOOP-1703: Sqoop2: rename Type to Column Type + size to length + minor doc fixes 
(Veena Basavaraj via Abraham Elmahrek)
 2014-11-10 17:06:57 -08:00
Abraham Elmahrek
ace222374b SQOOP-1348: Sqoop2: Remove Data class 
(Veena Basavaraj via Abraham Elmahrek)
 2014-11-10 13:18:38 -08:00
Abraham Elmahrek
a389c2c7c7 SQOOP-1697: Sqoop2: HDFS Connector TestLoader.verifyOutput have invalid default value for Hadoop 1 
(Jarek Jarcec Cecho via Abraham Elmahrek)
 2014-11-08 23:24:30 -08:00
Jarek Jarcec Cecho
d7a8175ae0 SQOOP-1695: Sqoop2: Removed hardcoded version in pom.xml of connector-sdk 
(Gwen Shapira via Jarek Jarcec Cecho)
 2014-11-08 22:00:38 -08:00
Jarek Jarcec Cecho
7a642cea83 SQOOP-1694: Sqoop2: Fix broken Hadoop100 build 
(Gwen Shapira via Jarek Jarcec Cecho)
 2014-11-08 20:53:08 -08:00
Jarek Jarcec Cecho
a63c9efe19 SQOOP-1661: Sqoop2: Intermediate data format text null handling 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-11-05 13:45:06 -08:00
Jarek Jarcec Cecho
ef0a19b986 SQOOP-1669: Sqoop2: JDBC connector does not understand iso8610 representation using " " as separator 
(Qian Xu via Jarek Jarcec Cecho)
 2014-11-05 06:35:37 -08:00
Jarek Jarcec Cecho
bb52e54eea SQOOP-1671: Fix incorrect merge from SQOOP-1645 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-11-04 07:21:16 -08:00
Abraham Elmahrek
d6319e3a7b SQOOP-1469: Sqoop2: Validations: Rename constants in Status class 
(Jarek Jarcec Cecho via Abraham Elmahrek)
 2014-11-03 13:18:50 -08:00
Abraham Elmahrek
8a7d950cee SQOOP-1639: Sqoop2: CLOB data type wrong type 
(Gwen Shapira via Abraham Elmahrek)
 2014-10-30 14:03:43 -07:00
Abraham Elmahrek
fcd456d6d1 SQOOP-1383: Sqoop2: MSSQL Export not working 
(Oleksiy Sayankin via Abraham Elmahrek)
 2014-10-30 14:00:16 -07:00
Jarek Jarcec Cecho
ecd9cbe209 SQOOP-1645: Update label text and (optional) required info for the generic jdbc connector config properties 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-10-30 07:37:05 -07:00
Abraham Elmahrek
a203e77264 SQOOP-1439: Sqoop2: Validations: Remove all references to the original Validation infastructure 
(Jarek Jarcec Cecho via Abraham Elmahrek)
 2014-10-28 11:37:58 -07:00
Jarek Jarcec Cecho
520fc33ca3 SQOOP-1620: Sqoop2: FileSystem should be configurable in HDFS connector 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-27 13:32:22 -07:00
Jarek Jarcec Cecho
fde0eb177d SQOOP-1515: VersionRequestHandler - fixes 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-10-27 11:02:19 -07:00
Jarek Jarcec Cecho
8c604754a4 SQOOP-1554: Add NullConfigurationClass/ EmptyConfigurationClass to support use cases that do not have a particular type of config 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-10-22 22:52:07 -07:00
Jarek Jarcec Cecho
39a2200007 SQOOP-1551: Repository Upgrader api - Extensibility 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-10-21 06:39:32 -07:00
Abraham Elmahrek
b345b46546 SQOOP-1575: Sqoop2: Validations: Migrate HDFS connector to new validators 
(Jarek Jarcec Cecho Via Abraham Elmahrek)
 2014-10-10 16:50:55 -07:00
Jarek Jarcec Cecho
c78b75a645 SQOOP-1562: Sqoop2: BIT handling in CSV IDF 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 18:22:51 -07:00
Jarek Jarcec Cecho
1e9db0113f SQOOP-1561: Sqoop2: Date and DateTime handling in CSV IDF 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 18:22:51 -07:00
Abraham Elmahrek
8362c73cc0 SQOOP-1498: Sqoop2: Repository Object refactoring (objects prefixed with M) 
(Veena Basavaraj via Abraham Elmahrek)
 2014-10-09 18:22:51 -07:00
Jarek Jarcec Cecho
c1e53e5d54 SQOOP-1560: Sqoop2: Move matcher out of Schema 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:59:24 -07:00
Chiwan Park
97da12aa50 SQOOP-1478: Sqoop2: Migrate remaining tests from junit 3 to 4 2014-10-09 17:59:24 -07:00
Gwen Shapira
2c20d920f4 SQOOP-1378: Sqoop2: From/To: Refactor schema 
This patch also changes the tools documentation.
 2014-10-09 17:59:24 -07:00
Veena Basavaraj
049994a021 SQOOP-1497: Sqoop2: Entity Nomenclature Revisited 2014-10-09 17:58:18 -07:00
Abraham Elmahrek
3d539dd4d7 SQOOP-1496: Sqoop2: Revisit/Refactor the SubmissionEngine/ExecutionEngine APIs 2014-10-09 17:58:18 -07:00
Jarek Jarcec Cecho
af25bccc2f SQOOP-1506: Sqoop2: From/To: Re-enable all tests 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
e71dd75793 SQOOP-1468: Sqoop2: Validations: Introduce advanced validators that can be parametrized 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
c0b22b1d62 SQOOP-1487: Sqoop2: From/To: Refactor/Create HDFS connector test cases 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
8fee134f7f SQOOP-1476: Generic JDBC Connector - DB connections not closed 
(Claire Fautsch via Jarek Jarcec Cecho)
 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
51a07bc352 SQOOP-1374: From/To: Metadata upgrade 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
2873a4b1ec SQOOP-1463: Sqoop2: From/To: Re-enable generic-jdbc-connector test cases 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:58:16 -07:00
Gwen Shapira
4d9513cea8 SQOOP-1375: Sqoop2: From/To: Create HDFS connector 2014-10-09 17:58:16 -07:00
Jarek Jarcec Cecho
1ebf1b89b3 SQOOP-1417: Sqoop2: From/To: Change ConnectorType name 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:48:31 -07:00
Abraham Elmahrek
e2d7ac6b85 Sqoop2: Validations: Provide Validation annotations 2014-10-09 17:30:56 -07:00
Jarek Jarcec Cecho
153b6badf7 SQOOP-1384: Sqoop2: From/To: Refactor Generic JDBC Connector 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:30:56 -07:00
Jarek Jarcec Cecho
0ad7401bb5 SQOOP-1376: Sqoop2: From/To: Refactor connector interface 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:30:55 -07:00
Jarek Jarcec Cecho
f18a29bf17 SQOOP-1379: Sqoop2: From/To: Disable tests 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:30:55 -07:00
Jarek Jarcec Cecho
3c93930bf3 SQOOP-777: Sqoop2: Implement intermediate data format representation policy 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-07-26 11:37:50 -07:00
Hari Shreedharan
0756d13662 SQOOP-1320. Sqoop2: Log entire SQLExceptions chain in GenericJdbcExecutor 
(Jaroslav Cecho via Hari Shreedharan)
 2014-05-12 12:23:12 -07:00
Jarek Jarcec Cecho
dccaf0b258 SQOOP-1308: Database export with the Generic-JDBC-Connector loses rows 
(Kristian Kottke via Jarek Jarcec Cecho)
 2014-05-08 08:05:59 -07:00
Hari Shreedharan
eab812d2f2 SQOOP-1258. Sqoop2: FrameworkMetadataUpgrade can't handle new inputs 
(Jarek Jarcec Cecho via Hari Shreedharan)
 2013-12-13 19:24:47 -08:00
Jarek Jarcec Cecho
e33d693476 SQOOP-974: Sqoop2: Add staging table support to generic jdbc export job 
(Raghav Kumar Gautam via Jarek Jarcec Cecho)
 2013-09-11 01:11:54 -07:00
Hari Shreedharan
ff8e0500ad SQOOP-663. Sqoop2: Introduce connector SDK 
(Jarek Jarcec Cecho via Hari Shreedharan)
 2013-07-31 11:44:04 -07:00
Venkat Ranganathan
9c7adb4e11 SQOOP-1154: Sqoop2: Text partitioner might miss or include edge values 
(Jarek Jarcec Cecho via Venkat Ranganathan)
 2013-07-30 22:47:44 -07:00
Jarek Jarcec Cecho
91b121ccaa SQOOP-1049: Sqoop2: Record not imported if partition column value is NULL 
(Mengwei Ding via Jarek Jarcec Cecho)
 2013-07-21 10:27:55 -07:00
Jarek Jarcec Cecho
1f016abb93 SQOOP-672: Unify logger usage across entire code base 
(Raghav Kumar Gautam via Jarek Jarcec Cecho)
 2013-07-11 17:28:44 -07:00
Jarek Jarcec Cecho
a3abffcd59 SQOOP-1130: Sqoop2: Sqoop MapReduce Job Failed when max and min boundary are both null 
(Mengwei Ding via Jarek Jarcec Cecho)
 2013-07-11 15:29:04 -07:00
Hari Shreedharan
1b2441d21d SQOOP-1121. Sqoop2: Serialize schema and make them available in the MR job. 
(Jarek Jarcec Cecho via Hari Shreedharan)
 2013-07-10 10:57:54 -07:00
Jarek Jarcec Cecho
59c2188be7 SQOOP-1113: Sqoop2: Text splitter will fail on interval "Breezy Badger"" to "Warty Warthog" 
(Venkat Ranganathan via Jarek Jarcec Cecho)
 2013-07-03 16:12:17 -07:00
Jarek Jarcec Cecho
d4b2d61653 SQOOP-1112: Sqoop2: Date splitter might return splits omitting some boundaries 
(Venkat Ranganathan via Jarek Jarcec Cecho)
 2013-07-02 16:29:27 -07:00
Venkat Ranganathan
aa8e1e7794 SQOOP-1073: Sqoop2: Introduce schema for transferred data 
(Jarek Jarcec Cecho via Venkat Ranganathan)
 2013-06-30 21:05:50 -07:00
Jarek Jarcec Cecho
05a73ef168 SQOOP-1080: Sqoop2: Investigate Jenkins test failures 
(Venkat Ranganathan via Jarek Jarcec Cecho)
 2013-06-16 06:40:35 -07:00
Kate Ting
5d388493e4 SQOOP-1060: Sqoop2: Increase maximal size of custom query in Generic JDBC Connector 
(Jarek Jarcec Cecho via Kate Ting)
 2013-06-14 10:49:45 -04:00
Jarek Jarcec Cecho
84127409a6 SQOOP-1013: Sqoop2: Provide splitters for additional data types to Generic JDBC Connector 
(Venkat Ranganathan via Jarek Jarcec Cecho)
 2013-06-13 13:39:43 -07:00
Jarek Jarcec Cecho
61335e6e82 SQOOP-1048: Sqoop2: NPE when importing NULL value 
(Vasanth kumar RJ via Jarek Jarcec Cecho)
 2013-05-20 06:12:28 -07:00
Kate Ting
2941fa666c SQOOP-1046: Sqoop2: Importing single row using decimal splitter will not import anything 
(Jarek Jarcec Cecho via Kate Ting)
 2013-05-15 00:51:28 -04:00
Jarek Jarcec Cecho
dd3bfa3981 SQOOP-1012: Sqoop2: Generic JDBC Connector should have one static instance of validator 
(Vasanth kumar RJ via Jarek Jarcec Cecho)
 2013-05-02 22:37:02 -07:00
Jarek Jarcec Cecho
8107248608 SQOOP-1024: GenericJdbcConnectorUpgrader must ignore inputs which may not exist in old version 
(Hari Shreedharan via Jarek Jarcec Cecho)
 2013-05-01 17:09:57 -07:00
Jarek Jarcec Cecho
c4467c6770 SQOOP-659: Design metadata upgrade procedure 
(Hari Shreedharan via Jarek Jarcec Cecho)
 2013-04-18 21:15:28 -07:00
Kate Ting
288cc731ec SQOOP-966: Sqoop2: Remove placeholder class IgnoredForm 
(Jarek Jarcec Cecho via Kate Ting)
 2013-04-15 12:13:40 -04:00
Jarek Jarcec Cecho
57d4d3aa02 SQOOP-903: Sqoop2: Add schema support to Generic JDBC Connector 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2013-03-15 13:22:07 -07:00
Cheolsoo Park
6eb27b821d SQOOP-888: Move out checking of special condition token to Validator in Generic JDBC Manager 
(Jarcec Cecho via Cheolsoo Park)
 2013-02-22 12:19:06 -08:00
Cheolsoo Park
641a9c856f SQOOP-785: Add splitter implementation for NUMERIC/DECIMAL type 
(Jarcec Cecho via Cheolsoo Park)
 2013-02-14 23:48:42 -08:00
Cheolsoo Park
ed9c514361 SQOOP-864: Introduce ETL context objects 
(Jarcec Cecho via Cheolsoo Park)
 2013-02-10 12:55:31 -08:00
Jarek Jarcec Cecho
3ea5145a96 SQOOP-871: Connector-level job-specific prop gives wrong help msg 
(Will McQueen via Jarek Jarcec Cecho)
 2013-02-08 19:56:39 -08:00
Cheolsoo Park
727e6f198d SQOOP-858: Add validation messages on form level 
(Jarcec Cecho via Cheolsoo Park)
 2013-02-06 13:11:08 -08:00
Cheolsoo Park
d5dc3a28b2 SQOOP-845: Improve Generic JDBC validator 
(Jarcec Cecho via Cheolsoo Park)
 2013-01-31 09:47:56 -08:00
Cheolsoo Park
eef227a5f9 SQOOP-843: Generic JDBC connector is committing transaction on export with autoCommit on 
(Jarcec Cecho via Cheolsoo Park)
 2013-01-30 15:23:36 -08:00
Cheolsoo Park
92062d5343 SQOOP-842: Put partition to template in Extractor as well 
(Jarcec Cecho via Cheolsoo Park)
 2013-01-30 15:13:18 -08:00
Cheolsoo Park
52dece8fa8 SQOOP-826: Add log4j test configuration to all maven modules 
(Jarek Jarcec Cecho via Cheolsoo Park)
 2013-01-22 15:53:42 -08:00
Cheolsoo Park
f89c8e59f2 SQOOP-814: Start using configuration objects in Generic JDBC Connector 
(Jarek Jarcec Cecho via Cheolsoo Park)
 2013-01-22 15:41:26 -08:00