Skip to main content

Advertisement

Table 2 Hardware requirements of some Big Data processing frameworks

From: Big Data management in smart grid: concepts, requirements and implementation

Framework Hadoop Storm Spark Flink
Operating systems Red Hat Enterprise Linux (RHEL) v5.x or 6.x (64-bit) CentOS v5.x or 6.x (64-bit) SUSE Linux Enterprise Server 11, SP1 (64-bit) CentOS Linux Windows Windows XP/7/8 Mac OS X 10.7-9 Linux Linux Mac OS X Windows (Cygwin)
RAM 64 GB at least 8 GB at least 8 GB at least 8 GB at least
CPU 2 cores at least 8 cores at least 8 cores at least 8 cores at least
Network 10 Gigabit at least 10 Gigabit at least 10 Gigabit at least 10 Gigabit at least
Hard disk 12–24 disks per node for each 1TB at least 6 disks per node for each 1TB at least 4–8 disks per node for each 1TB at least 12–24 disks per node for each 1TB at least