mapreduce
How to tell hadoop how much memory to allocate to a single mapper job?
I\'ve created a Elastic MapReduce job, and I\'m trying to optimize its performance. At this moment I\'m trying to increase the number of mappers per instance. I am 开发者_运维问答doing this via mapre[详细]
2023-04-08 17:47 分类:问答Hadoop java mapper -copyFromLocal heap size error
As part of my Java mapper I have a command executes some code on the local node and copies a local output file to the hadoop fs.Unfortunately I\'m getting the following output:[详细]
2023-04-08 14:56 分类:问答How to set setMaxMapTaskFailuresPercent in hadoop's new api?
Before, you could set max failures percent by using: JobConf.setMaxMapTaskFailuresPercent(int) but now, that\'s obsolete.[详细]
2023-04-08 13:16 分类:问答Map reduce value list order problem
As we know Hadoop groups values with per key and sends them to same reduce task. Suppose I have next lines in file on hdfs.[详细]
2023-04-07 19:39 分类:问答Type mismatch in key from map when replacing Mapper with MultithreadMapper
I\'d like to implement a MultithreadMapper for my MapReduce job. For this I replaced Mapper with MultithreadMapper in a working code.[详细]
2023-04-07 14:28 分类:问答Hadoop java mapper job executing on slave node, directory issue
As part of my Java mapper I have a command executes some standalone code on a local slave node.When I run a code it executes fine, unless it is trying to access some local files in which case I get th[详细]
2023-04-07 11:58 分类:问答RavenDB Index Querying on Nested Properties
sssI currently have an index called SchoolMetrics that aggregates several fields on the School field as the key and produces documents like this:[详细]
2023-04-07 11:48 分类:问答How to pull data in the Map/Reduce functions?
According to the Hadoop : The Definitive Guide. The new API supports both a “push” and a “pull” style of iteration. In both APIs, key-value record pairs are pushed to the mapper, but i开发者_Go百[详细]
2023-04-06 22:58 分类:问答hadoop : supporting multiple outputs for Map Reduce jobs
Seems like it is supported in Hado开发者_StackOverflow中文版op(reference), but I dont know how to use this.[详细]
2023-04-06 21:46 分类:问答Map Reduce To Get Most popular tags
I have a problem that I need some help on but I feel I\'m close. It involves Lithium and MongoDB Code looks like this:[详细]
2023-04-06 17:32 分类:问答