5
0
mirror of https://github.com/apache/sqoop.git synced 2025-05-10 11:33:21 +08:00
Commit Graph

183 Commits

Author SHA1 Message Date
Kate Ting
cde1c3ac9e SQOOP-2698: Sqoop2: RESTiliency: Split the InvalidRESTCallsTest into independent test cases
(Jarek Jarcec Cecho via Kate Ting)
2015-11-20 14:26:21 -08:00
Jarek Jarcec Cecho
4f0e28625a SQOOP-2680: Sqoop2: Remove the id from public interface for connection
(Colin Ma via Jarek Jarcec Cecho)
2015-11-17 09:08:35 -08:00
Jarek Jarcec Cecho
09f71be0af SQOOP-2682: Sqoop2: Add test cases for the object name with special char
(Colin Ma via Jarek Jarcec Cecho)
2015-11-17 09:04:01 -08:00
Jarek Jarcec Cecho
aaee89dc6c SQOOP-2678: Sqoop2: Remove the id from public interface for Link
(Colin Ma via Jarek Jarcec Cecho)
2015-11-13 11:54:05 -08:00
Hari Shreedharan
60f54b624b SQOOP-2667. Sqoop2: RESTiliency: Refactore the one line try-catch statement in InvalidRESTTest
(Jarcec via Hari)
2015-11-12 15:58:38 -08:00
Hari Shreedharan
43c478df5c SQOOP-2660. Sqoop2: Generic JDBC: Convert input Columns from String to List
(Jarcec via Hari)
2015-11-12 15:55:06 -08:00
Jarek Jarcec Cecho
6dde896158 SQOOP-2675: Sqoop2: Remove the id from public interface for Job
(Colin Ma via Jarek Jarcec Cecho)
2015-11-12 13:08:02 -08:00
Hari Shreedharan
ede322199d SQOOP-2652. Sqoop2: Add test case for S3 incremental import to HDFS
(Jarcec via Hari)
2015-11-12 11:45:52 -08:00
Hari Shreedharan
8ea1c8580e SQOOP-2670. Sqoop2: RESTiliency: Allow getting links by connector only for all
(Jarcec via Hari)
2015-11-09 14:23:47 -08:00
Hari Shreedharan
4459bd9251 SQOOP-2659. Sqoop2: Do not stop services that haven't been started in our integration test suite
(Jarcec via Hari)
2015-11-09 14:19:18 -08:00
Jarek Jarcec Cecho
84590aa4ab SQOOP-2656: Sqoop2: NPE will happen in connector-loading-tests when do the slow integration test
(Colin Ma via Jarek Jarcec Cecho)
2015-11-04 07:58:01 -08:00
Jarek Jarcec Cecho
492459615e SQOOP-2645: Sqoop2: Ensure that classpath loading integration tests are run by default
(Abraham Fine via Jarek Jarcec Cecho)
2015-10-30 08:01:34 -07:00
Jarek Jarcec Cecho
f33554a19e SQOOP-2629: Sqoop2: Add ability to "blacklist" connectors
(Abraham Fine via Jarek Jarcec Cecho)
2015-10-27 20:14:19 -07:00
Jarek Jarcec Cecho
bc0de7c199 SQOOP-1690: Implement doAs for Sqoop2
(Abraham Fine via Jarek Jarcec Cecho)
2015-10-27 09:26:59 -07:00
Hari Shreedharan
6a10db0153 SQOOP-2619. Sqoop2: Provide ability to run integration tests against real Sqoop 2 server
(Jarcec via Hari)
2015-10-22 00:31:10 -07:00
Jarek Jarcec Cecho
4e22045043 SQOOP-2463: Sqoop2: Add support for schema-less to schema-less transfer for CSV IDF
(Abraham Fine via Jarek Jarcec Cecho)
2015-10-21 08:06:41 -07:00
Jarek Jarcec Cecho
1ea3db992b SQOOP-1732: Sqoop2: Add version to connector upgrade API
(Abraham Fine via Jarek Jarcec Cecho)
2015-10-14 14:55:55 -07:00
Jarek Jarcec Cecho
0ea90d024f SQOOP-2610: Sqoop2: Tomcat related code should be cleanup
(Colin Ma via Jarek Jarcec Cecho)
2015-10-09 11:42:50 -07:00
Hari Shreedharan
2a9e8d9948 SQOOP-2598. Sqoop2: Main sqoop.log is missing log outputs from classes other then org.apache.sqoop
(Jarcec via Hari)
2015-10-08 23:29:57 -07:00
Jarek Jarcec Cecho
d3fbe102ac SQOOP-2490: Sqoop2: Add extra jars to job
(Abraham Fine via Jarek Jarcec Cecho)
2015-10-06 20:31:28 -07:00
Jarek Jarcec Cecho
c8780d0fe6 SQOOP-910: Sqoop2: Move to embedded jetty from tomcat
(Colin Ma via Jarek Jarcec Cecho)
2015-09-30 08:22:00 -07:00
Hari Shreedharan
bf09850c33 SQOOP-2524. Sqoop2: Add S3 support to HDFS Connector
(Jarcec via Hari)
2015-09-24 21:22:17 -07:00
Jarek Jarcec Cecho
615defb10f SQOOP-2583: Sqoop2: Encode object name in the http request
(Dian Fu via Jarek Jarcec Cecho)
2015-09-21 19:16:16 -07:00
Jarek Jarcec Cecho
5fcdd3bafd SQOOP-2584: Sqoop2: Fix test failure in InvalidRESTCallsTest
(Dian Fu via Jarek Jarcec Cecho)
2015-09-21 19:11:34 -07:00
Hari Shreedharan
bd7252480f SQOOP-2525. Sqoop2: Add support for incremental From in HDFS Connector
(Jarcec via Hari)
2015-09-18 12:52:25 -07:00
Hari Shreedharan
208d5daf45 SQOOP-2547. Sqoop2: RESTiliency: Provide REST tests for v1/connector servlet
(Jarcec via Hari Shreedharan)
2015-09-18 12:14:31 -07:00
Jarek Jarcec Cecho
933839f0f7 SQOOP-2539: Sqoop2: Enforce resource name not null when creating table
(Dian Fu via Jarek Jarcec Cecho)
2015-09-08 12:48:01 +02:00
Abraham Elmahrek
d11e833931 SQOOP-2507: Sqoop2: Do not use default Tomcat handlers for unsupported HTTP methods
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-08-26 18:00:42 -07:00
Jarek Jarcec Cecho
3864ccf036 SQOOP-2528: Sqoop2: findbugs: Fix warning in test module
(Colin Ma via Jarek Jarcec Cecho)
2015-08-25 09:00:40 -07:00
Jarek Jarcec Cecho
d26c5031bd SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-08-21 18:03:54 -07:00
Jarek Jarcec Cecho
242146581e SQOOP-2499: Sqoop2: Findbugs: Fix the problem of URF_UNREAD_PUBLIC_OR_PROTECTED_FIELD for ExampleValue
(Colin Ma via Jarek Jarcec Cecho)
2015-08-18 09:38:12 -07:00
Abraham Elmahrek
58b2d1c1c4 SQOOP-2487: Sqoop2: ConnectorTestCase have wrong order of arguments in assertEquals
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-08-17 13:54:54 -07:00
Jarek Jarcec Cecho
719e3aa966 SQOOP-2474: Fix the problem in the integration test case Derby1_99_4UpgradeTest
(Colin Ma via Jarek Jarcec Cecho)
2015-08-14 07:48:14 -07:00
Abraham Elmahrek
6f5d428931 SQOOP-2469: Sqoop2: Custom HTTP requests test base class
Provide base integration test that will run custom HTTP requests and validating the server response.

(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-08-13 13:55:07 -07:00
Abraham Elmahrek
3362fbb1b1 SQOOP-2244: Sqoop2: Generic JDBC: Automatically escape table and column names from configuration objects
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-08-10 13:44:17 -07:00
Abraham Elmahrek
ec2d2619ee SQOOP-2424: Sqoop2: Provide custom TestNG listener in integration tests
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-07-23 12:13:12 -07:00
Jarek Jarcec Cecho
4d2db87b3a SQOOP-2365: Sqoop2: Create annotation and base class
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-07-22 17:47:47 -07:00
Jarek Jarcec Cecho
3dc19d6f0f SQOOP-2414: Sqoop2: Change JUnit Assert class to TestNG Assert class
(Richard via Jarek Jarcec Cecho)
2015-07-13 07:41:54 -07:00
Jarek Jarcec Cecho
81b42fe4c0 SQOOP-2398: Sqoop2: Show all job with order
(Richard via Jarek Jarcec Cecho)
2015-07-10 09:26:55 -07:00
Richard Zhou
c812ec586b SQOOP-2366: Sqoop2: Create infrastructure providers for hadoop, tomcat, and database providers
(Abraham Elmahrek via Richard Zhou)
2015-07-08 16:44:14 +08:00
Qian Xu
1192c2a4c2 SQOOP-2409: Sqoop2: Bump up Tomcat version to 6.0.37 in integration test
(Richard Zhou via Qian Xu)
2015-07-07 10:25:38 +08:00
Abraham Elmahrek
7edaa11d22 SQOOP-2405: Sqoop2: Remove active wait in test cases after executeJob() call
(Banmeet Singh via Abraham Elmahrek)
2015-06-26 10:45:16 -07:00
Abraham Elmahrek
4a5bd295d8 SQOOP-2382: Sqoop2: Arithmetic exception in partitioner when allow null is true
(Banmeet Singh via Abraham Elmahrek)
2015-06-23 13:47:33 -07:00
Abraham Elmahrek
06e9cdca47 SQOOP-2369: Sqoop2: Use random port for AJP end point in TomcatSqoopMiniCluster
(Guoquan Shen via Abraham Elmahrek)
2015-05-29 18:20:47 -07:00
Jarek Jarcec Cecho
d013d94dbb SQOOP-2360: Sqoop2: Upgrade should consider both directions for a single connector
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-05-26 12:29:20 -07:00
Gwen Shapira
9ee44d4f0a SQOOP-2356: Sqoop2: Derby upgrade should automatically rename jobs that have conflicting names
(Abraham Elmahrek via Gwen Shapira)
2015-05-15 11:19:25 +03:00
Abraham Elmahrek
d2cf56680a SQOOP-2341: Sqoop2: Test repository infrastructure
(Syed Hashmi via Abraham Elmahrek)
2015-05-14 20:10:13 -07:00
Jarek Jarcec Cecho
5abd3f91f0 SQOOP-2342: Sqoop2: Provide an external application classloader
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-04-30 14:25:43 -07:00
Jarek Jarcec Cecho
a59d69f6c4 SQOOP-1953: Sqoop2: Tomcat at beginning of Suite
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-04-26 14:59:16 -07:00
Jarek Jarcec Cecho
1857086722 SQOOP-2322: Sqoop2: Kafka topic should vary on a per method basis
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-04-26 12:09:29 -07:00
Jarek Jarcec Cecho
8f82051188 SQOOP-1952: Sqoop2: Load miniclusters at beginning of integration tests
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-04-23 15:04:41 -07:00
Jarek Jarcec Cecho
78af5eae9c SQOOP-2320: Sqoop2: AllTypesTest should be in slow category
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-04-21 19:29:23 -07:00
Jarek Jarcec Cecho
5297bf552a SQOOP-2321: Sqoop2: Clean up FromRDBMSToHDFS test
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-04-21 19:26:45 -07:00
Abraham Elmahrek
9f05b4a5cf SQOOP-1803: Sqoop2: Update and save configuration upon job success
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-04-20 17:32:12 -07:00
Jarek Jarcec Cecho
31b2a1ae45 SQOOP-2196: Sqoop2: Add Runner factory for Kafka
(Syed A. Hashmi via Jarek Jarcec Cecho)
2015-04-16 18:50:00 -07:00
Jarek Jarcec Cecho
bfc10914c1 SQOOP-2269: Sqoop2: Parquet integration tests
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-04-14 12:28:59 -07:00
Gwen Shapira
33e8a49ef6 SQOOP-2285: Sqoop2: Change POM version back to 2.0.0
(Abraham Elmahrek via Gwen Shapira)
2015-04-06 15:32:11 -07:00
Abraham Elmahrek
ff1f2f2438 SQOOP-2207: Update POM with new version
(Richard Zhou via Abraham Elmahrek)
2015-04-02 21:46:18 -07:00
Jarek Jarcec Cecho
213caf0714 SQOOP-2229: Sqoop2: Kite connector should handle doubles
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-04-01 08:56:37 -07:00
Abraham Elmahrek
3a655ad37a SQOOP-2265: Sqoop2: Standardize on methods
(Richard Zhou via Abraham Elmahrek)
2015-03-30 10:33:20 -07:00
Jarek Jarcec Cecho
45d1c32d7e SQOOP-2016: Sqoop2: Create integration test for JDBC to Hive
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-03-24 17:41:13 -07:00
Abraham Elmahrek
756a3c17e2 SQOOP-2242: Sqoop2: Add support for full table names into our DatabaseProvider infrastructure
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-03-19 19:10:40 -07:00
Abraham Elmahrek
a63da71adf SQOOP-1949: Sqoop2: HDFS append only support
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-03-18 23:43:00 -07:00
Abraham Elmahrek
24feea1850 SQOOP-2157: Sqoop2: Kite: Add simple integration test for TO direction
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-03-18 23:42:11 -07:00
Abraham Elmahrek
f98fc28859 SQOOP-1738: Sqoop2: HDFS Connector : Check for output directory
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-03-17 12:39:30 -07:00
Abraham Elmahrek
6ca31c5054 SQOOP-2201: Sqoop2: Add possibility to read Hadoop configuration files to HFDS connector
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-03-16 22:43:23 -07:00
Abraham Elmahrek
1abf38d631 SQOOP-2169: Sqoop2: Kafka integration test bug
(Gwen Shapira via Abraham Elmahrek)
2015-03-16 20:05:31 -07:00
Abraham Elmahrek
e6519c76c6 SQOOP-1805: Sqoop2: GenericJdbcConnector: Delta read support
(jarek Jarcec Cecho via Abraham Elmahrek)
2015-03-16 10:13:05 -07:00
Abraham Elmahrek
3f618c9176 SQOOP-1068: Sqoop2: Add integration tests for real cluster
(Syed Hashmi via Abraham Elmahrek)
2015-03-11 14:12:19 -07:00
Abraham Elmahrek
dedd84a4af SQOOP-2172: Sqoop2: Move ErrorCode's sub-class from sqoop-core to sqoop-common
(Richard Zhou via Abraham Elmahrek)
2015-03-05 18:33:28 -08:00
Abraham Elmahrek
b835c69a6e SQOOP-2171: Sqoop2: Incorrect basic type boxing with JDK1.7
(Syed A. Hashmi via Abraham Elmahrek)
2015-03-05 00:29:49 -08:00
Abraham Elmahrek
3ba01bcf83 SQOOP-2160: Sqoop2: Datatypes: Provide foundation for the exhaustive type checks
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-03-04 11:35:25 -08:00
Abraham Elmahrek
934a009762 SQOOP-2156: Sqoop2: HdfsUtils.getOutputMapreduceFiles should ignore hidden files
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-03-02 18:27:28 -08:00
Abraham Elmahrek
68595856f6 SQOOP-2159: Sqoop2: Use BeforeSuite/AfterSuite for startHadoop/stopHadoop in integration tests
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-03-02 18:19:58 -08:00
Jarek Jarcec Cecho
418b9a70f8 SQOOP-1579: Sqoop2: Data transfer to load into Hive does not work
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-02-27 06:49:04 -08:00
Jarek Jarcec Cecho
cb037c16a0 SQOOP-1790: Sqoop2: Upgrade configs with name conflicts
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-02-26 07:09:39 -08:00
Jarek Jarcec Cecho
26164d8f7c SQOOP-1592: Sqoop2: Remove Hadoop1 profile
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-02-09 11:42:24 -08:00
Abraham Elmahrek
922e1e6725 SQOOP-2081: Sqoop2: Provide ability to dump content of testing table to log
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-02-05 15:24:23 -08:00
Abraham Elmahrek
3858e364a9 SQOOP-2078: Sqoop2: Add ParametrizedUtils.toArrayOfArrays utils method
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-02-05 15:21:11 -08:00
Abraham Elmahrek
d43dc1b0b5 SQOOP-2077: Sqoop2: Enclose missing/extra lines in output of HdfsAsserts.assertMapreduceOutput
(Jarek Jarcec Cecho via Abraham Elmahrek)
2015-02-05 15:17:30 -08:00
Jarek Jarcec Cecho
332a7bdd80 SQOOP-1591: Sqoop2: PostgreSQL integration tests
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-02-03 20:25:04 -08:00
Abraham Elmahrek
27d87b4f2f SQOOP-1862: Sqoop2: JDBC Connector To side needs to handle converting JODA objects to sql date
(Veena Basavaraj via Abraham Elmahrek)
2015-02-03 13:58:36 -08:00
Gwen Shapira
041d42fd55 SQOOP-1572: Sqoop2: Duplicate Column Name in Multiple Tables Import
(Abraham Elmahrek via Gwen Shapira)
2015-01-23 10:19:01 -08:00
Abraham Elmahrek
913521e1a9 SQOOP-1821: Sqoop2: External connector loading
(Veena Basavaraj via Abraham Elmahrek)
2015-01-20 12:50:15 -08:00
Jarek Jarcec Cecho
819b13802a SQOOP-2004: Sqoop2: Make annotations run always
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-01-15 07:41:48 -08:00
Hari Shreedharan
471e534ef6 SQOOP-1950. Sqoop2: Use TestNG
(Abraham Elmahrek via Hari Shreedharan)
2015-01-08 16:41:18 -08:00
Jarek Jarcec Cecho
dcb3eb3405 SQOOP-1962: Sqoop2: Start sqoop2 minicluster on random port
(Abraham Elmahrek via Jarek Jarcec Cecho)
2015-01-05 09:25:26 +01:00
Abraham Elmahrek
c89f168d49 SQOOP-1776: Sqoop2: Delegation Token support for Authentication
(Richard Zhou via Abraham Elmahrek)
2014-12-28 00:22:52 -08:00
Abraham Elmahrek
2f0e73067f SQOOP-1871: Sqoop2: Upgrade to Hadoop 2.6.0
(Richard Zhou via Abraham Elmahrek)
2014-12-25 18:08:14 -08:00
Abraham Elmahrek
236b9ef9cc SQOOP-1869: Sqoop2: Expand schema matching to support two schemaless connectors
(Gwen Shapira via Abraham Elmahrek)
2014-12-18 09:52:01 -08:00
Abraham Elmahrek
cf9af00812 SQOOP-1879: Sqoop2: Submission Engine does not set all details on SubmissionRecord in Local mode
(Veena Basavaraj via Abraham Elmahrek)
2014-12-16 18:08:22 -08:00
Abraham Elmahrek
98d12b4799 SQOOP-1911: Sqoop2: Derby1_99_4UpgradeTest is constantly failing on pre-commit hook
(Jarek Jarcec Cecho via Abraham Elmahrek)
2014-12-16 10:28:08 -08:00
Abraham Elmahrek
4b8fa56931 SQOOP-1783: Sqoop2: Create derby integration upgrade tests
(Jarek Jarcec Cecho via Abraham Elmahrek)
2014-12-15 10:17:52 -08:00
Abraham Elmahrek
e2e5aa8bf5 SQOOP-1852: Sqoop2: Kafka connector supporting TO direction
(Gwen Shapira via Abraham Elmahrek)
2014-12-11 17:53:48 -06:00
Abraham Elmahrek
9151d305af SQOOP-1839: Sqoop2: Mapreduce submission record should propogate failure info as well
(Veena Basavaraj via Abraham Elmahrek)
2014-12-11 01:43:34 -06:00
Abraham Elmahrek
1626157427 SQOOP-1837: Sqoop2: Verify that executing job has been successful in ConnectorTestCase
(Jarek Jarcec Cecho via Abraham Elmahrek)
2014-12-08 10:40:56 -06:00
Abraham Elmahrek
2099cbad65 SQOOP-1832: Sqoop2: Enforce that integration test working directory is always in target/ directory
(Jarek Jarcec Cecho via Abraham Elmahrek)
2014-12-07 23:52:44 -06:00
Abraham Elmahrek
9febdf3aed SQOOP-1831: Sqoop2: Log filenames of detected Mapreduce files in HdfsUtils
(Jarek Jarcec Cecho via Abraham Elmahrek)
2014-12-04 00:30:13 -08:00
Abraham Elmahrek
ae31a02372 SQOOP-1815: Sqoop2: Date and DateTime is not encoded in Single Quotes
Also includes unit tests.

(Veena Basavaraj via Abraham Elmahrek)
2014-12-03 23:48:34 -08:00
Abraham Elmahrek
59ffd88025 SQOOP-1588: Sqoop2: TO-side: Write data to HDFS
(Qian Xu via Abraham Elmahrek)
2014-11-17 22:03:17 -08:00