Table 3 The important parameters of the configuration in the experiments
From: HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework
Parameters | Values |
|---|---|
mapreduce.reduce.memory.mb | 3072 |
mapreduce.map.memory.mb | 1024 |
mapred.maxthreads.generate.mapoutput | 2 |
mapreduce.tasktracker.reserved.physicalmemory.mb.low | 0.95 |
mapred.maxthreads.partition.closer | 2 |
mapreduce.map.sort.spill.percent | 0.99 |
mapreduce.reduce.merge.inmem.threshold | 0 |
mapreduce.job.reduce.slowstart.completedmaps | 1 |
mapreduce.reduce.shuffle.parallecopies | 40 |
mapreduce.map.speculative | False |
mapreduce.reduce.speculative | False |
mapreduce.map.output.compress | False |
mapreduce.job.reduces | 160 |
mapreduce.task.io.sort.mb | 480 |
mapreduce.task.io.sort.factor | 400 |
mfs.heapsize | 35 |