From: HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework
Data size (GB) | Number of maps | Number of data local map task | Number of rack local map task | Average map time (s) | Average reduce time (s) | Average shuffle time(s) | Elapsed time (s) |
---|---|---|---|---|---|---|---|
8 | 65 | 59,61 | 6,4 | 8,9 | 7,52 | 23,26 | 57,103 |
16 | 130 | 127,129 | 3,1 | 7,8 | 13,93 | 56,58 | 125,205 |
24 | 195 | 191,192 | 4,3 | 7,7 | 17,150 | 86,83 | 145,321 |
32 | 260 | 255,255 | 5,5 | 7,8 | 24,198 | 111,124 | 227,447 |
40 | 325 | 323,322 | 2,3 | 7,8 | 31,242 | 149,155 | 274,508 |
48 | 390 | 387,378 | 3,12 | 8,9 | 37,288 | 185,234 | 344,652 |
56 | 455 | 448,449 | 7,6 | 8,9 | 47,353 | 210,256 | 367,780 |
64 | 520 | 514,493 | 6,27 | 7,10 | 59,403 | 242,342 | 437,904 |
72 | 585 | 581,575 | 4,10 | 7,9 | 81,451 | 280,350 | 600,987 |
80 | 650 | 645,639 | 5,11 | 8,9 | 99,511 | 322,413 | 645,1116 |