Skip to main content

Table 1 Job profile information for experiment of Terasort and Wordcount benchmarks

From: HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework

Data size (GB)

Number of maps

Number of data local map task

Number of rack local map task

Average map time (s)

Average reduce time (s)

Average shuffle time(s)

Elapsed time (s)

8

65

59,61

6,4

8,9

7,52

23,26

57,103

16

130

127,129

3,1

7,8

13,93

56,58

125,205

24

195

191,192

4,3

7,7

17,150

86,83

145,321

32

260

255,255

5,5

7,8

24,198

111,124

227,447

40

325

323,322

2,3

7,8

31,242

149,155

274,508

48

390

387,378

3,12

8,9

37,288

185,234

344,652

56

455

448,449

7,6

8,9

47,353

210,256

367,780

64

520

514,493

6,27

7,10

59,403

242,342

437,904

72

585

581,575

4,10

7,9

81,451

280,350

600,987

80

650

645,639

5,11

8,9

99,511

322,413

645,1116