开发者

Specify multiple input files for a hadoop job

开发者 https://www.devze.com 2023-03-07 06:46 出处:网络
Is there a way to specify multiple input files for a hadoop job? I\'ve tried separation using \',\' but that didnt\' work...any other suggestions?

Is there a way to specify multiple input files for a hadoop job? I've tried separation using ',' but that didnt' work...any other suggestions?

I was able to do so...by writing my own method to do a split based off of the splitter 开发者_StackOverflow社区selected and then adding the newly created paths to the job conf


You can specify a directory as the input path and it will process all files in that directory.

0

精彩评论

暂无评论...
验证码 换一张
取 消