Skip to main content

TableĀ 1 Job profile information for experiment of Terasort and Wordcount benchmarks

From: HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework

Data size (GB)Number of mapsNumber of data local map taskNumber of rack local map taskAverage map time (s)Average reduce time (s)Average shuffle time(s)Elapsed time (s)
86559,616,48,97,5223,2657,103
16130127,1293,17,813,9356,58125,205
24195191,1924,37,717,15086,83145,321
32260255,2555,57,824,198111,124227,447
40325323,3222,37,831,242149,155274,508
48390387,3783,128,937,288185,234344,652
56455448,4497,68,947,353210,256367,780
64520514,4936,277,1059,403242,342437,904
72585581,5754,107,981,451280,350600,987
80650645,6395,118,999,511322,413645,1116