Skip to main content

Table 7 YARN client mode cluster configuration with 2 executors

From: Instance segmentation on distributed deep learning big data cluster

Machine type

Specifications

Master VM

- 6 GB RAM

- 6 processor cores

- 130 GB HD

Slave1 VM

- 5 GB RAM

- 4 processor cores

- 130 GB HD

YARN node manager memory

- Master node: 5 GB

- Slave1 node: 5 GB

Executor/Driver

- Number of nodes: 2

- Worker cores: 2

- Worker memory: 3 GB

- Driver memory: 2 GB

- Driver cores: 2