Skip to main content

Table 6 YARN client mode cluster configuration with 3 executors

From: Instance segmentation on distributed deep learning big data cluster

Machine type

Specifications

Master VM

- 6 GB RAM

- 6 processor cores

- 130 GB HD

Slave1 VM

- 5 GB RAM

- 4 processor cores

- 130 GB HD

Slave2 VM

- 5 GB RAM

- 4 processor cores

- 130 GB HD

YARN node manager memory

- Master node: 5 GB

- Slave1 and Slave2 nodes: 4 GB

Executor/Driver

- Number of nodes: 3

- Worker cores: 2

- Worker memory: 3 GB

- Driver memory: 2 GB

- Driver cores: 2