5
0
mirror of https://github.com/apache/sqoop.git synced 2025-05-08 02:50:38 +08:00
Commit Graph

188 Commits

Author SHA1 Message Date
Jarek Jarcec Cecho
35a060e048 SQOOP-1544: Sqoop2: From/To: ConnectorBean should work support different directions
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:59:24 -07:00
Gwen Shapira
2c20d920f4 SQOOP-1378: Sqoop2: From/To: Refactor schema
This patch also changes the tools documentation.
2014-10-09 17:59:24 -07:00
Jarek Jarcec Cecho
d0153621d3 SQOOP-1542: Sqoop2: From/To: MConnector should handle null forms
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:58:18 -07:00
Veena Basavaraj
049994a021 SQOOP-1497: Sqoop2: Entity Nomenclature Revisited 2014-10-09 17:58:18 -07:00
Jarek Jarcec Cecho
27fb31d42e SQOOP-1454: Sqoop2: From/To: Add client support for supported directions
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:58:18 -07:00
Abraham Elmahrek
3d539dd4d7 SQOOP-1496: Sqoop2: Revisit/Refactor the SubmissionEngine/ExecutionEngine APIs 2014-10-09 17:58:18 -07:00
Jarek Jarcec Cecho
af25bccc2f SQOOP-1506: Sqoop2: From/To: Re-enable all tests
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
f89368e2a0 SQOOP-1465: Sqoop2: Validations: Add support for multiple validation messages to Model classes 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
e71dd75793 SQOOP-1468: Sqoop2: Validations: Introduce advanced validators that can be parametrized 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
51a07bc352 SQOOP-1374: From/To: Metadata upgrade
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
cd882a9f3c SQOOP-1466: Sqoop2: Validations: Execute validators during Connection and Job creation on Server side 2014-10-09 17:58:17 -07:00
Jarek Jarcec Cecho
58bb8dd07a SQOOP-1467: Sqoop2: Make MAccountableEntity inherit from MValidatedElement rather then MPersistableEntity 2014-10-09 17:58:17 -07:00
Gwen Shapira
4d9513cea8 SQOOP-1375: Sqoop2: From/To: Create HDFS connector 2014-10-09 17:58:16 -07:00
Jarek Jarcec Cecho
c23853d714 SQOOP-1449: Sqoop2: From/To: Re-enable common tests
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:58:16 -07:00
Jarek Jarcec Cecho
b69f4aca3b SQOOP-1447: Sqoop2: From/To: Change DirectionError messages
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:48:31 -07:00
Jarek Jarcec Cecho
1ebf1b89b3 SQOOP-1417: Sqoop2: From/To: Change ConnectorType name
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:48:31 -07:00
Jarek Jarcec Cecho
a53e4141ac SQOOP-1441: Sqoop2: Validations: Enforce defined validations 2014-10-09 17:48:31 -07:00
Abraham Elmahrek
e2d7ac6b85 Sqoop2: Validations: Provide Validation annotations 2014-10-09 17:30:56 -07:00
Jarek Jarcec Cecho
2e79f9094c SQOOP-1416: Sqoop2: From/To: Investigate multiple variables for "from" and "to"
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:30:56 -07:00
Jarek Jarcec Cecho
68becd49d4 SQOOP-1425: Sqoop2: Improve ClassUtils to enable use of primitive types and subclasses 2014-10-09 17:30:55 -07:00
Jarek Jarcec Cecho
b90c6a2b80 SQOOP-1426: Sqoop2: ThrowableBean should correct reconstruct SqoopException 2014-10-09 17:30:55 -07:00
Jarek Jarcec Cecho
0ad7401bb5 SQOOP-1376: Sqoop2: From/To: Refactor connector interface
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:30:55 -07:00
Jarek Jarcec Cecho
f18a29bf17 SQOOP-1379: Sqoop2: From/To: Disable tests
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-10-09 17:30:55 -07:00
Veena Basavaraj
4433bacf8a SQOOP-1436: Sqoop2: Support custom form name via the Form Annotation 2014-08-26 19:19:07 -07:00
Jarek Jarcec Cecho
3c93930bf3 SQOOP-777: Sqoop2: Implement intermediate data format representation policy
(Abraham Elmahrek via Jarek Jarcec Cecho)
2014-07-26 11:37:50 -07:00
Hari Shreedharan
30581fb4e5 SQOOP-1234. Sqoop2: Clean up comments in MSubmission class
(Jarek Jarcec Cecho via Hari Shreedharan)
2014-02-02 21:09:16 -08:00
Hari Shreedharan
ebe62d3663 SQOOP-1189. Sqoop2: Ensure that clone methods will correctly copy over all values from all parents
(Jarek Jarcec Cecho via Hari Shreedharan)
2013-10-23 22:09:55 -07:00
Jarek Jarcec Cecho
78235e39df SQOOP-827: Sqoop2: MMapInput is null while retrieving from DB if pass empty map on write
(Mengwei Ding via Jarek Jarcec Cecho)
2013-08-19 08:26:52 -07:00
Jarek Jarcec Cecho
c07c857589 SQOOP-1142: Sqoop2: Provide creater and last edited by to metadata structures
(Mengwei Ding via Jarek Jarcec Cecho)
2013-08-14 15:27:48 -07:00
Jarek Jarcec Cecho
a7d9b1b338 SQOOP-1075: Sqoop2: Persist Framework metadata version in repository
(Raghav Kumar Gautam via Jarek Jarcec Cecho)
2013-07-29 20:27:16 -07:00
Jarek Jarcec Cecho
69ecc93d4a SQOOP-1141: Sqoop2: Provide ability to enable/disable connections and jobs
(Mengwei Ding via Jarek Jarcec Cecho)
2013-07-27 17:42:34 -07:00
Jarek Jarcec Cecho
9f8ac6b6b2 SQOOP-1145: Sqoop2: Use JSON object for serializing MAP input type
(Abraham Elmahrek via Jarek Jarcec Cecho)
2013-07-27 10:25:50 -07:00
Jarek Jarcec Cecho
91b121ccaa SQOOP-1049: Sqoop2: Record not imported if partition column value is NULL
(Mengwei Ding via Jarek Jarcec Cecho)
2013-07-21 10:27:55 -07:00
Hari Shreedharan
20bbef04c4 SQOOP-1105. Sqoop2: Remove our implementation of StringUtils
(Raghav Kumar Gautam via Hari Shreedharan)
2013-07-12 16:29:52 -07:00
Hari Shreedharan
4997f97bc3 SQOOP-1136. Sqoop2: MBooleanInput should copy persistenceId when cloning.
(Mengwei Ding via Hari Shreedharan)
2013-07-12 16:12:30 -07:00
Hari Shreedharan
1b2441d21d SQOOP-1121. Sqoop2: Serialize schema and make them available in the MR job.
(Jarek Jarcec Cecho via Hari Shreedharan)
2013-07-10 10:57:54 -07:00
Venkat Ranganathan
aa8e1e7794 SQOOP-1073: Sqoop2: Introduce schema for transferred data
(Jarek Jarcec Cecho via Venkat Ranganathan)
2013-06-30 21:05:50 -07:00
Jarek Jarcec Cecho
344c6309c8 SQOOP-1100: Sqoop2: Missing setBoolean() method for MutableContext interface
(Mengwei Ding via Jarek Jarcec Cecho)
2013-06-26 12:26:33 -07:00
Kate Ting
fd4be5f5e8 SQOOP-1076: Sqoop2: Introduce Boolean model type
(Jarek Jarcec Cecho via Kate Ting)
2013-06-22 20:43:33 -04:00
Jarek Jarcec Cecho
f0e8fee3e0 SQOOP-1088: Sqoop2: Submission history API
(Mengwei Ding via Jarek Jarcec Cecho)
2013-06-22 15:33:49 -07:00
Jarek Jarcec Cecho
94c91efd3b SQOOP-995: Sqoop2: Add cloning ability to model classes
(Vasanth kumar RJ via Jarek Jarcec Cecho)
2013-05-23 01:16:00 -07:00
Jarek Jarcec Cecho
c4467c6770 SQOOP-659: Design metadata upgrade procedure
(Hari Shreedharan via Jarek Jarcec Cecho)
2013-04-18 21:15:28 -07:00
Jarek Jarcec Cecho
dd61adf66c SQOOP-947: Sqoop2: Introduce the concept of "sensitivity" input to all supported metadata structures
(Abraham Elmahrek via Jarek Jarcec Cecho)
2013-03-25 13:33:15 -07:00
Jarek Jarcec Cecho
b49b71235d SQOOP-941: Sqoop2: Do not send sensitive values from server to client
(Abraham Elmahrek via Jarek Jarcec Cecho)
2013-03-23 08:03:10 -07:00
Kate Ting
b94c22919e SQOOP-958: Fix white space handling when generating version info
(Abraham Elmahrek via Kate Ting)
2013-03-09 09:28:08 -05:00
Cheolsoo Park
0cc834928a SQOOP-919: Improve Form API for simple java handling
(Jarcec Cecho via Cheolsoo Park)
2013-03-10 22:57:20 -07:00
Jarek Jarcec Cecho
2642b66cfe SQOOP-664: Send user name as HTTP header in client to server communication
(Abraham Elmahrek via Jarek Jarcec Cecho)
2013-03-01 10:54:59 -08:00
Cheolsoo Park
e8ca6f6c93 SQOOP-875: ClassUtils.instantiate class should not be logging on ERROR level
(Jarcec Cecho via Cheolsoo Park)
2013-02-10 13:03:45 -08:00
Cheolsoo Park
ed9c514361 SQOOP-864: Introduce ETL context objects
(Jarcec Cecho via Cheolsoo Park)
2013-02-10 12:55:31 -08:00
Cheolsoo Park
727e6f198d SQOOP-858: Add validation messages on form level
(Jarcec Cecho via Cheolsoo Park)
2013-02-06 13:11:08 -08:00
Cheolsoo Park
612060139a SQOOP-812: Serialization of Configuration objects to and from json is not working properly
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-22 16:00:27 -08:00
Cheolsoo Park
52dece8fa8 SQOOP-826: Add log4j test configuration to all maven modules
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-22 15:53:42 -08:00
Cheolsoo Park
acfc0ae02a SQOOP-835: Do not recreate package-info.java each compilation
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-22 10:02:23 -08:00
Jarek Jarcec Cecho
7b097a97a8 SQOOP-831: Unit test for common module
(Vasanth kumar RJ via Jarek Jarcec Cecho)
2013-01-17 01:50:08 -08:00
Cheolsoo Park
5b2fbfd1c7 SQOOP-806: Put "creation" and "lastUpdate" date to Connection and Job objects
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-09 12:47:32 -08:00
Cheolsoo Park
b9842ebe04 SQOOP-822: Git repository revision is not fetched
(Jarek Jarcec Cecho via Cheolsoo Park)
2013-01-09 11:53:19 -08:00
Cheolsoo Park
6491782225 SQOOP-774: exception is thrown when creating a connection object if
connectionString starts with an empty space

(Jarek Jarcec Cecho via Cheolsoo Park)
2012-12-17 11:53:10 -08:00
Bilung Lee
671d84934e SQOOP-739 Connectors should be versionable
(Jarek Jarcec Cecho)
2012-12-07 20:04:46 -08:00
Bilung Lee
a633fb0b34 SQOOP-737 Option to set number of extractors and loaders
(Jarek Jarcec Cecho)
2012-12-04 12:28:23 -08:00
Bilung Lee
8a5cd6728a SQOOP-734 Change ConnectorBean to send JSON objects
(Jarek Jarcec Cecho)
2012-12-03 17:54:29 -08:00
Bilung Lee
80a11f972c SQOOP-667 Persist all properties of MSubmission metadata
(Jarek Jarcec Cecho)
2012-11-26 08:34:00 -08:00
Jarek Jarcec Cecho
2c9a4eb46c SQOOP-671: Mapreduce counters are not used in generated mapreduce jobs
(Hari Shreedharan via Jarek Jarcec Cecho)
2012-11-14 10:56:53 -08:00
Bilung Lee
211c67819e SQOOP-662 Introduce pluggable configuration objects
(Jarek Jarcec Cecho)
2012-11-13 20:34:18 -08:00
Bilung Lee
fa815557c5 SQOOP-646 Provide support for "set" metadata in Sqoop 2
(Jarek Jarcec Cecho)
2012-11-09 18:27:09 -08:00
Bilung Lee
379451fe3c SQOOP-676 Add lastUpdateDate to MSubmission
(Jarek Jarcec Cecho)
2012-11-06 16:25:39 -08:00
Bilung Lee
71f404460d SQOOP-680 Re enable unit tests for map reduce execution
(Jarek Jarcec Cecho)
2012-11-06 16:15:05 -08:00
Bilung Lee
25f3fd331f SQOOP-679 Wrap exception to MSubmission metadata object
(Jarek Jarcec Cecho)
2012-11-05 14:16:09 -08:00
Jarek Jarcec Cecho
0976713f01 SQOOP-655: Generic JDBC connector for export
(Bilung Lee via Jarek Jarcec Cecho)
2012-11-04 08:02:53 -08:00
Bilung Lee
2481b7f8d0 SQOOP-656 End to end submission engine
(Jarek Jarcec Cecho)
2012-11-02 15:29:33 -07:00
Bilung Lee
5807db8c3e SQOOP-629: Provide better exception handling during server-client communication
(Jarek Jarcec Cecho)
2012-10-17 09:38:15 -07:00
Bilung Lee
a46b25f5e5 SQOOP-627: Convert forms structures on connector level to configuration classes
(Jarek Jarcec Cecho)
2012-10-17 09:23:39 -07:00
Bilung Lee
38dc198a5d SQOOP-618 Remove most important FindBugs warnings and errors in Sqoop 2
(Jarek Jarcec Cecho)
2012-10-08 18:25:07 -07:00
Bilung Lee
202ae0630b SQOOP-619 Display user persistent id of newly created connection and job objects
(Jarek Cecho)
2012-10-05 13:10:37 -07:00
Bilung Lee
13439909f3 SQOOP-613 Add support for integer type to metadata model 2012-10-03 16:42:07 -07:00
Bilung Lee
866d46dfe7 SQOOP-608 Implement job resource from end to end 2012-09-20 14:47:31 -07:00
Bilung Lee
47cb311a5f SQOOP-596: Implement connection resource end-to-end 2012-09-07 12:40:34 -07:00
Bilung Lee
c050e18ebc SQOOP-584 Create facility to validate user supplied connection and job forms
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1377757 13f79535-47bb-0310-9956-ffa450edef68
2012-08-27 17:25:57 +00:00
Bilung Lee
9a77b4fff1 SQOOP-576 Implement command show framework
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1377755 13f79535-47bb-0310-9956-ffa450edef68
2012-08-27 17:17:37 +00:00
Bilung Lee
c1e44563d5 SQOOP-576 Implement command show framework
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1377752 13f79535-47bb-0310-9956-ffa450edef68
2012-08-27 17:16:19 +00:00
Bilung Lee
c32afa5aea SQOOP-497: Enhance repository interface to support Connection CRUD
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1376202 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 19:25:51 +00:00
Bilung Lee
ab2313875b SQOOP-544: Split job metadata for different job types (import, export)
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1373069 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:37:26 +00:00
Bilung Lee
517c2c1bb7 SQOOP-535: Support splitting metadata to connector and framework specific
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1370814 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 15:41:15 +00:00
Jarek Jarcec Cecho
d096c57fae SQOOP-537. TestMPersistableEntity does not contain license header.
(Abhijeet Gaikwad via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1369200 13f79535-47bb-0310-9956-ffa450edef68
2012-08-03 20:41:33 +00:00
Bilung Lee
867e18fb02 SQOOP-534: Add ability to find out if MPersistableEntity do already have persistent ID
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1368623 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 17:51:30 +00:00
Jarek Jarcec Cecho
e19d63b625 SQOOP-502. Implement show connector command end-to-end.
(Bilung Lee via Jarek Jarcec Cecho)


git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1360620 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 10:34:34 +00:00
Bilung Lee
ed631e9250 SQOOP-365 Show connector command
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1346742 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 05:57:26 +00:00
Bilung Lee
8d2a0ed56c SQOOP-365 Sqoop distribution automation with maven
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1344408 13f79535-47bb-0310-9956-ffa450edef68
2012-05-30 18:44:14 +00:00
Daniel Shahaf
b71b4caccd move sqoop to TLP
git-svn-id: https://svn.apache.org/repos/asf/sqoop/branches/sqoop2@1306066 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 00:04:41 +00:00