Skip to main content

Table 2 Experimental configuration of the Hadoop cluster

From: Runtime prediction of big data jobs: performance comparison of machine learning algorithms and analytical models

Server configuration
 Processor 2.9 GHz
 Main memory 64 GB
 Storage 10 TB
Node configuration
 CPU Intel (R) Xeon (R) CPU E3-1231 v3@3.40 GHz
 Main memory 32 GB
 Number of nodes 9
 Storage 6 TB each, 54 TB total
 CPU cores 8 each, 72 total
 Operating system Ubuntu 16.04.2 (GNU/Linux 4.13.0-37-generic x86 64)
 Hadoop 2.4.0
 Spark 2.1.0
 JDK 1.7.0