Table 2 Experimental Hadoop cluster
From: A parallelization model for performance characterization of Spark Big Data jobs on Hadoop clusters
Server configuration | Processor | 2.9 GHz |
Main memory | 64 GB | |
Local storage | 10 TB | |
Node configuration | CPU Specification | Intel(R) Xeon(R) CPU E3-1231 v3 @ 3.40 GHz |
Main memory | 32 GB | |
Number of nodes | 10 | |
Local storage | 6 TB each, 60 TB total | |
CPU cores | 8 each, 80 total | |
Software | Operating System | Ubuntu 16.04.2 (GNU/Linux 4.13.0-37-generic x86 64) |
JDK | 1.7.0 | |
Hadoop | 2.4.0 | |
Spark | 2.1.0 |