Skip to main content

Table 2 Hardware requirements of some Big Data processing frameworks

From: Big Data management in smart grid: concepts, requirements and implementation

Framework

Hadoop

Storm

Spark

Flink

Operating systems

Red Hat Enterprise

Linux (RHEL) v5.x or

6.x (64-bit)

CentOS v5.x or 6.x (64-bit)

SUSE Linux Enterprise Server 11, SP1 (64-bit)

CentOS

Linux

Windows

Windows XP/7/8

Mac OS X 10.7-9

Linux

Linux

Mac OS X

Windows (Cygwin)

RAM

64 GB at least

8 GB at least

8 GB at least

8 GB at least

CPU

2 cores at least

8 cores at least

8 cores at least

8 cores at least

Network

10 Gigabit at least

10 Gigabit at least

10 Gigabit at least

10 Gigabit at least

Hard disk

12–24 disks per node for each 1TB at least

6 disks per node for each 1TB at least

4–8 disks per node for each 1TB at least

12–24 disks per node for each 1TB at least