Skip to main content

Table 2 Hadoop cluster experimental setup and specifications

From: IoT Big Data provenance scheme using blockchain on Hadoop ecosystem

Node configuration

Hardware

Specifications

Server configuration

Processor

2.9 GHz

Main memory

64 GB

Local storage

10 TB

Node configuration

CPU

Intel\(\circledR\) Xenon\(\circledR\)

CPU E3-1231 v3@ 3.40 GHz

Main memory

32 GB

Number of nodes

5

Local storage

6 TB each, 30 TB Total

CPU cores

8 each, 40 total

Software

Operating System

Ubuntu 16.04.2

(GNU/Linux 4.13.0-37-generic x86 64)

JDK

1.7.0

Hadoop

2.4.0

Spark

2.1.0

Workload

Varying data sizes and batch sizes

Submitted by the HLF client application