Table 2 Experimental Hadoop cluster

Server configuration

Processor

2.9 GHz

Main Memory

64 GB

Local Storage

10 TB

Node configuration

CPU

Intel(R) Xeon(R) CPU E3-1231 v3 @ 3.40GHz

Main Memory

32 GB

Number of Nodes

10

Local Storage

6 TB each, 60 TB total

CPU cores

8 each, 80 total

Software

Operating System

Ubuntu 16.04.2 (GNU/Linux 4.13.0-37-generic×86 64)

JDK

1.7.0

Hadoop

2.4.0

Spark

2.1.0

Workload

Micro Benchmarks

WordCount, and TeraSort