github/sqoop
5
0
Fork 0
mirror of https://github.com/apache/sqoop.git synced 2025-05-07 03:20:27 +08:00
Code Issues Projects Releases Wiki Activity
807 Commits 21 Branches 30 Tags 24 MiB
d593a550aa
Commit Graph

201 Commits

Author SHA1 Message Date
Abraham Elmahrek
7631d29333 SQOOP-1936: Sqoop2: Sort by comparing IDF data in shuffle phase 
(Veena Basavaraj via Abraham Elmahrek)
 2015-01-12 21:16:13 -08:00
Abraham Elmahrek
2d54e26a08 SQOOP-1995: Sqoop2: Allow nulls only if the column for that field has IsNullable to be true 
(Veena Basavaraj via Abraham Elmahrek)
 2015-01-12 19:03:28 -08:00
Abraham Elmahrek
4adc766b54 SQOOP-1996: Sqoop2: Change getNullable to isNullable 
(Veena Basavaraj via Abraham Elmahrek)
 2015-01-09 11:43:52 -08:00
Abraham Elmahrek
89dcbe879e SQOOP-1956: Sqoop2: Cleanup IDF implementations 
(Veena Basavaraj via Abraham Elmahrek)
 2015-01-09 11:16:05 -08:00
Hari Shreedharan
471e534ef6 SQOOP-1950. Sqoop2: Use TestNG 
(Abraham Elmahrek via Hari Shreedharan)
 2015-01-08 16:41:18 -08:00
Abraham Elmahrek
f073cf6938 SQOOP-1647: Sqoop2: Read data from HDFS in KiteConnector 
(Qian Xu via Abraham Elmahrek)
 2015-01-07 21:11:33 -08:00
Abraham Elmahrek
3bb9c595d9 SQOOP-1902: Sqoop2: Avro IDF class and unit tests 
(Veena Basavaraj via Abraham Elmahrek)
 2015-01-07 18:28:39 -08:00
Jarek Jarcec Cecho
60066b8f38 SQOOP-1968: Optimize schema operation in getMatchingData of NameMatcher 
(Qian Xu via Jarek Jarcec Cecho)
 2015-01-07 12:13:06 +01:00
Abraham Elmahrek
dc50e4074f SQOOP-1974: Sqoop2: parseCSVString in SQOOPIDFUtils add more tests 
(Veena Basavaraj via Abraham Elmahrek)
 2015-01-06 13:11:13 -08:00
Abraham Elmahrek
ae26b9668e SQOOP-1751: Sqoop2: Rearrange LinkConfig and ToJobConfig of Kite Connector 
(Qian Xu via Abraham Elmahrek)
 2015-01-06 00:27:27 -08:00
Abraham Elmahrek
4ffa806bac SQOOP-1901: Sqoop2: Support DRY code in IDF impementations and add JSONIDF 
(Veena Basavaraj via Abraham Elmahrek)
 2015-01-05 18:56:45 -08:00
Abraham Elmahrek
c7ef89dba0 SQOOP-1870: Sqoop2: Merge SPI and connector-sdk packages 
(Veena Basavaraj via Abraham Elmahrek)
 2015-01-05 10:47:10 -08:00
Jarek Jarcec Cecho
1cf075fdff SQOOP-1969: Support getColumnSize method for Schema class 
(Qian Xu via Jarek Jarcec Cecho)
 2015-01-05 12:13:59 +01:00
Jarek Jarcec Cecho
d56d6417f4 SQOOP-1927: Sqoop2: Move CSVURIValidator into validators package 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2015-01-05 08:02:47 +01:00
Abraham Elmahrek
02786f0e20 SQOOP-1624: Sqoop2: Apply repository upgrader api 
Add supported direction check when upgrading connector as well.

(Qian Xu via Abraham Elmahrek)
 2014-12-25 21:57:36 -08:00
Abraham Elmahrek
7f53eb22e3 SQOOP-1929: Sqoop2: Track number of records written in Loader 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-22 18:14:23 -08:00
Hari Shreedharan
2fdeeb06d6 Sqoop2: Add test categories 
(Abraham Elmahrek via Hari Shreedharan)
 2014-12-19 15:33:43 -08:00
Abraham Elmahrek
236b9ef9cc SQOOP-1869: Sqoop2: Expand schema matching to support two schemaless connectors 
(Gwen Shapira via Abraham Elmahrek)
 2014-12-18 09:52:01 -08:00
Abraham Elmahrek
43160f72d4 SQOOP-1879: Sqoop2: Convert the List in Schema Columns to Array for better lookup time 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-15 21:03:55 -08:00
Jarek Jarcec Cecho
80662d6d45 SQOOP-1898: Change the API of getJars to use SET than LIST to avoid duplicate jars 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-15 08:28:51 -08:00
Jarek Jarcec Cecho
5abcdd4d6d SQOOP-1899: Minor change to CSVIDF to use Set instead of Lists 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-14 22:41:41 -08:00
Jarek Jarcec Cecho
4527916766 SQOOP-1882: JobManager currently ignores the TO connector IDF and assumed all IDF use String for the generic T 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-14 12:39:41 -08:00
Jarek Jarcec Cecho
b35d7573da SQOOP-1872: IDF API should expose a method to add dependent jars 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-13 14:29:15 -08:00
Jarek Jarcec Cecho
a78adb468a SQOOP-1893: add license header to TestSqoopIDFUtils 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-13 11:39:35 -08:00
Abraham Elmahrek
293e9ef636 SQOOP-1813: Sqoop2: Add SqoopIDFUtils class and unit tests 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-12 20:27:09 -06:00
Jarek Jarcec Cecho
dda5e1edd3 SQOOP-1885: Sqoop2: KafkaConnector pom.xml needs license header 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-12-12 09:58:10 -08:00
Abraham Elmahrek
1fc6589221 SQOOP-1825: Sqoop2: Handle NULLs for all types in CSV Intermediate Data Format 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-12 11:52:26 -06:00
Abraham Elmahrek
e2e5aa8bf5 SQOOP-1852: Sqoop2: Kafka connector supporting TO direction 
(Gwen Shapira via Abraham Elmahrek)
 2014-12-11 17:53:48 -06:00
Venkat Ranganathan
c820aaf870 SQOOP-1678: Sqoop2: [HDFS Connector] Configurable null values 
(Abraham Elmahrek via Venkat Ranganathan)
 2014-12-10 20:50:15 -08:00
Jarek Jarcec Cecho
486af80f45 SQOOP-1811: Sqoop2: Change IDF *TextData to *CSVTextData 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-10 10:28:27 -08:00
Abraham Elmahrek
fdc0469505 SQOOP-1845: Sqoop2: Make DateTime Column type support datetime with and without timezone 
(Veena Basavaraj via Abraham ELmahrek)
 2014-12-08 17:13:09 -06:00
Abraham Elmahrek
d38e239b90 SQOOP-1846: Sqoop2: Update CSVIntermediateFormat DateTime tests to use modified ISO-8601 format 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-05 16:52:04 -08:00
Abraham Elmahrek
c865aefea6 SQOOP-1817: Sqoop2: Update CSVIntermediate BIT data type 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-05 15:57:39 -08:00
Abraham Elmahrek
c19f9c9460 SQOOP-1765: Sqoop2: Time/Timestamp format support for CSV IDF 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-04 13:21:50 -08:00
Abraham Elmahrek
ae31a02372 SQOOP-1815: Sqoop2: Date and DateTime is not encoded in Single Quotes 
Also includes unit tests.

(Veena Basavaraj via Abraham Elmahrek)
 2014-12-03 23:48:34 -08:00
Abraham Elmahrek
1675c512ad SQOOP-1843: Sqoop2: Fix timestamp type casting 
(Veena Basavaraj via Abraham Elmahrek)
 2014-12-03 18:30:34 -08:00
Jarek Jarcec Cecho
1f4b7fd291 SQOOP-1830: GenericJdBcExtractor does not create java date objects when extracting 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-03 10:34:48 -08:00
Jarek Jarcec Cecho
38f2894ed6 SQOOP-1819: Support Enum in CSVIDF ( + add unit tests) 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-01 17:38:53 -08:00
Jarek Jarcec Cecho
d68c05d3ad SQOOP-1750: Support Map Type in CSV IDF 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-12-01 15:24:02 -08:00
Jarek Jarcec Cecho
34d7066c38 SQOOP-1749: Support List Type in CSV IDF 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-11-29 07:35:03 -08:00
Abraham Elmahrek
6ea427f9fe SQOOP-1806: Sqoop2: Remove the duplicate connector-config.properties file in Kite connector 
(Qian Xu via Abraham Elmahrek)
 2014-11-26 02:15:21 -08:00
Abraham Elmahrek
6991ff2fb4 SQOOP-1789: Sqoop2: Add validation for partition column when using query based import 
(Jarek Jarcec Cecho via Abraham Elmahrek)
 2014-11-24 14:05:28 -08:00
Jarek Jarcec Cecho
abd12fa544 SQOOP-1754: Sqoop2: Remove JarUtil class 
(Qian Xu via Jarek Jarcec Cecho)
 2014-11-19 09:13:05 -08:00
Jarek Jarcec Cecho
37a5552bab SQOOP-1752: Kite Connector should submit jars for CSV job 
(Qian Xu via Jarek Jarcec Cecho)
 2014-11-18 09:24:56 -08:00
Abraham Elmahrek
59ffd88025 SQOOP-1588: Sqoop2: TO-side: Write data to HDFS 
(Qian Xu via Abraham Elmahrek)
 2014-11-17 22:03:17 -08:00
Jarek Jarcec Cecho
af8571b644 SQOOP-1731: Sqoop2: Generic JDBC upgrade from 1.99.3 to 1.99.4 
(Abraham Elmahre via Jarek Jarcec Cecho)
 2014-11-14 06:27:00 -08:00
Jarek Jarcec Cecho
0ace9710eb SQOOP-1715: Make name for column required ( fix the corr tests) 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-11-12 22:28:08 -08:00
Abraham Elmahrek
3edf9cad6f SQOOP-1621: Sqoop2: Allow null as a dummy Schema 
(Veena Basavaraj via Abraham Elmahrek)
 2014-11-12 20:15:45 -08:00
Jarek Jarcec Cecho
4fd8dec145 SQOOP-1708: Rename Unsupported Column type to Unknown and add java doc 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-11-10 22:13:05 -08:00
Abraham Elmahrek
fe5d615bf1 SQOOP-1703: Sqoop2: rename Type to Column Type + size to length + minor doc fixes 
(Veena Basavaraj via Abraham Elmahrek)
 2014-11-10 17:06:57 -08:00
Abraham Elmahrek
ace222374b SQOOP-1348: Sqoop2: Remove Data class 
(Veena Basavaraj via Abraham Elmahrek)
 2014-11-10 13:18:38 -08:00
Abraham Elmahrek
a389c2c7c7 SQOOP-1697: Sqoop2: HDFS Connector TestLoader.verifyOutput have invalid default value for Hadoop 1 
(Jarek Jarcec Cecho via Abraham Elmahrek)
 2014-11-08 23:24:30 -08:00
Jarek Jarcec Cecho
d7a8175ae0 SQOOP-1695: Sqoop2: Removed hardcoded version in pom.xml of connector-sdk 
(Gwen Shapira via Jarek Jarcec Cecho)
 2014-11-08 22:00:38 -08:00
Jarek Jarcec Cecho
7a642cea83 SQOOP-1694: Sqoop2: Fix broken Hadoop100 build 
(Gwen Shapira via Jarek Jarcec Cecho)
 2014-11-08 20:53:08 -08:00
Jarek Jarcec Cecho
a63c9efe19 SQOOP-1661: Sqoop2: Intermediate data format text null handling 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-11-05 13:45:06 -08:00
Jarek Jarcec Cecho
ef0a19b986 SQOOP-1669: Sqoop2: JDBC connector does not understand iso8610 representation using " " as separator 
(Qian Xu via Jarek Jarcec Cecho)
 2014-11-05 06:35:37 -08:00
Jarek Jarcec Cecho
bb52e54eea SQOOP-1671: Fix incorrect merge from SQOOP-1645 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-11-04 07:21:16 -08:00
Abraham Elmahrek
d6319e3a7b SQOOP-1469: Sqoop2: Validations: Rename constants in Status class 
(Jarek Jarcec Cecho via Abraham Elmahrek)
 2014-11-03 13:18:50 -08:00
Abraham Elmahrek
8a7d950cee SQOOP-1639: Sqoop2: CLOB data type wrong type 
(Gwen Shapira via Abraham Elmahrek)
 2014-10-30 14:03:43 -07:00
Abraham Elmahrek
fcd456d6d1 SQOOP-1383: Sqoop2: MSSQL Export not working 
(Oleksiy Sayankin via Abraham Elmahrek)
 2014-10-30 14:00:16 -07:00
Jarek Jarcec Cecho
ecd9cbe209 SQOOP-1645: Update label text and (optional) required info for the generic jdbc connector config properties 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-10-30 07:37:05 -07:00
Abraham Elmahrek
a203e77264 SQOOP-1439: Sqoop2: Validations: Remove all references to the original Validation infastructure 
(Jarek Jarcec Cecho via Abraham Elmahrek)
 2014-10-28 11:37:58 -07:00
Jarek Jarcec Cecho
520fc33ca3 SQOOP-1620: Sqoop2: FileSystem should be configurable in HDFS connector 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-27 13:32:22 -07:00
Jarek Jarcec Cecho
fde0eb177d SQOOP-1515: VersionRequestHandler - fixes 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-10-27 11:02:19 -07:00
Jarek Jarcec Cecho
8c604754a4 SQOOP-1554: Add NullConfigurationClass/ EmptyConfigurationClass to support use cases that do not have a particular type of config 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-10-22 22:52:07 -07:00
Jarek Jarcec Cecho
39a2200007 SQOOP-1551: Repository Upgrader api - Extensibility 
(Veena Basavaraj via Jarek Jarcec Cecho)
 2014-10-21 06:39:32 -07:00
Abraham Elmahrek
b345b46546 SQOOP-1575: Sqoop2: Validations: Migrate HDFS connector to new validators 
(Jarek Jarcec Cecho Via Abraham Elmahrek)
 2014-10-10 16:50:55 -07:00
Jarek Jarcec Cecho
c78b75a645 SQOOP-1562: Sqoop2: BIT handling in CSV IDF 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 18:22:51 -07:00
Jarek Jarcec Cecho
1e9db0113f SQOOP-1561: Sqoop2: Date and DateTime handling in CSV IDF 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 18:22:51 -07:00
Abraham Elmahrek
8362c73cc0 SQOOP-1498: Sqoop2: Repository Object refactoring (objects prefixed with M) 
(Veena Basavaraj via Abraham Elmahrek)
 2014-10-09 18:22:51 -07:00
Jarek Jarcec Cecho
c1e53e5d54 SQOOP-1560: Sqoop2: Move matcher out of Schema 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:59:24 -07:00
Chiwan Park
97da12aa50 SQOOP-1478: Sqoop2: Migrate remaining tests from junit 3 to 4 2014-10-09 17:59:24 -07:00
Gwen Shapira
2c20d920f4 SQOOP-1378: Sqoop2: From/To: Refactor schema 
This patch also changes the tools documentation.
 2014-10-09 17:59:24 -07:00
Veena Basavaraj
049994a021 SQOOP-1497: Sqoop2: Entity Nomenclature Revisited 2014-10-09 17:58:18 -07:00
Abraham Elmahrek
3d539dd4d7 SQOOP-1496: Sqoop2: Revisit/Refactor the SubmissionEngine/ExecutionEngine APIs 2014-10-09 17:58:18 -07:00
Jarek Jarcec Cecho
af25bccc2f SQOOP-1506: Sqoop2: From/To: Re-enable all tests 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
e71dd75793 SQOOP-1468: Sqoop2: Validations: Introduce advanced validators that can be parametrized 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
c0b22b1d62 SQOOP-1487: Sqoop2: From/To: Refactor/Create HDFS connector test cases 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
8fee134f7f SQOOP-1476: Generic JDBC Connector - DB connections not closed 
(Claire Fautsch via Jarek Jarcec Cecho)
 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
51a07bc352 SQOOP-1374: From/To: Metadata upgrade 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
2873a4b1ec SQOOP-1463: Sqoop2: From/To: Re-enable generic-jdbc-connector test cases 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:58:16 -07:00
Gwen Shapira
4d9513cea8 SQOOP-1375: Sqoop2: From/To: Create HDFS connector 2014-10-09 17:58:16 -07:00
Jarek Jarcec Cecho
1ebf1b89b3 SQOOP-1417: Sqoop2: From/To: Change ConnectorType name 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:48:31 -07:00
Abraham Elmahrek
e2d7ac6b85 Sqoop2: Validations: Provide Validation annotations 2014-10-09 17:30:56 -07:00
Jarek Jarcec Cecho
153b6badf7 SQOOP-1384: Sqoop2: From/To: Refactor Generic JDBC Connector 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:30:56 -07:00
Jarek Jarcec Cecho
0ad7401bb5 SQOOP-1376: Sqoop2: From/To: Refactor connector interface 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:30:55 -07:00
Jarek Jarcec Cecho
f18a29bf17 SQOOP-1379: Sqoop2: From/To: Disable tests 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-10-09 17:30:55 -07:00
Jarek Jarcec Cecho
3c93930bf3 SQOOP-777: Sqoop2: Implement intermediate data format representation policy 
(Abraham Elmahrek via Jarek Jarcec Cecho)
 2014-07-26 11:37:50 -07:00
Hari Shreedharan
0756d13662 SQOOP-1320. Sqoop2: Log entire SQLExceptions chain in GenericJdbcExecutor 
(Jaroslav Cecho via Hari Shreedharan)
 2014-05-12 12:23:12 -07:00
Jarek Jarcec Cecho
dccaf0b258 SQOOP-1308: Database export with the Generic-JDBC-Connector loses rows 
(Kristian Kottke via Jarek Jarcec Cecho)
 2014-05-08 08:05:59 -07:00
Hari Shreedharan
eab812d2f2 SQOOP-1258. Sqoop2: FrameworkMetadataUpgrade can't handle new inputs 
(Jarek Jarcec Cecho via Hari Shreedharan)
 2013-12-13 19:24:47 -08:00
Jarek Jarcec Cecho
e33d693476 SQOOP-974: Sqoop2: Add staging table support to generic jdbc export job 
(Raghav Kumar Gautam via Jarek Jarcec Cecho)
 2013-09-11 01:11:54 -07:00
Hari Shreedharan
ff8e0500ad SQOOP-663. Sqoop2: Introduce connector SDK 
(Jarek Jarcec Cecho via Hari Shreedharan)
 2013-07-31 11:44:04 -07:00
Venkat Ranganathan
9c7adb4e11 SQOOP-1154: Sqoop2: Text partitioner might miss or include edge values 
(Jarek Jarcec Cecho via Venkat Ranganathan)
 2013-07-30 22:47:44 -07:00
Jarek Jarcec Cecho
91b121ccaa SQOOP-1049: Sqoop2: Record not imported if partition column value is NULL 
(Mengwei Ding via Jarek Jarcec Cecho)
 2013-07-21 10:27:55 -07:00
Jarek Jarcec Cecho
1f016abb93 SQOOP-672: Unify logger usage across entire code base 
(Raghav Kumar Gautam via Jarek Jarcec Cecho)
 2013-07-11 17:28:44 -07:00
Jarek Jarcec Cecho
a3abffcd59 SQOOP-1130: Sqoop2: Sqoop MapReduce Job Failed when max and min boundary are both null 
(Mengwei Ding via Jarek Jarcec Cecho)
 2013-07-11 15:29:04 -07:00
Hari Shreedharan
1b2441d21d SQOOP-1121. Sqoop2: Serialize schema and make them available in the MR job. 
(Jarek Jarcec Cecho via Hari Shreedharan)
 2013-07-10 10:57:54 -07:00
Jarek Jarcec Cecho
59c2188be7 SQOOP-1113: Sqoop2: Text splitter will fail on interval "Breezy Badger"" to "Warty Warthog" 
(Venkat Ranganathan via Jarek Jarcec Cecho)
 2013-07-03 16:12:17 -07:00
Jarek Jarcec Cecho
d4b2d61653 SQOOP-1112: Sqoop2: Date splitter might return splits omitting some boundaries 
(Venkat Ranganathan via Jarek Jarcec Cecho)
 2013-07-02 16:29:27 -07:00