github/sqoop
5
0
Fork 0
mirror of https://github.com/apache/sqoop.git synced 2025-05-21 11:21:39 +08:00
Code Issues Projects Releases Wiki Activity

SQOOP-891: Sqoop export from S3 to MySQL fails when S3 is not default filesystem.

Browse Source 
(Jurgen Van Gael via Jarek Jarcec Cecho)
This commit is contained in:
Jarek Jarcec Cecho 2013-05-20 07:27:53 -07:00
parent 403f0aece2
commit fd756a0c40
1 changed files with 5 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
src/java/org/apache/sqoop/mapreduce/CombineFileInputFormat.java
View File

@ -224,7 +224,11 @@ public List<InputSplit> getSplits(JobContext job)
// times, one time each for each pool in the next loop. // times, one time each for each pool in the next loop.
List<Path> newpaths = new LinkedList<Path>(); List<Path> newpaths = new LinkedList<Path>();
for (int i = 0; i < paths.length; i++) { for (int i = 0; i < paths.length; i++) {
Path p = new Path(paths[i].toUri().getPath()); FileSystem fs = paths[i].getFileSystem(conf);
//the scheme and authority will be kept if the path is
//a valid path for a non-default file system
Path p = fs.makeQualified(paths[i]);
newpaths.add(p); newpaths.add(p);
} }
paths = null; paths = null;