Skip to main content

Table 2 Experimental configuration of the Hadoop cluster

From: Runtime prediction of big data jobs: performance comparison of machine learning algorithms and analytical models

Server configuration

 Processor

2.9 GHz

 Main memory

64 GB

 Storage

10 TB

Node configuration

 CPU

Intel (R) Xeon (R) CPU E3-1231 v3@3.40 GHz

 Main memory

32 GB

 Number of nodes

9

 Storage

6 TB each, 54 TB total

 CPU cores

8 each, 72 total

Software

 Operating system

Ubuntu 16.04.2 (GNU/Linux 4.13.0-37-generic x86 64)

 Hadoop

2.4.0

 Spark

2.1.0

 JDK

1.7.0