Fig. 8From: Large scale performance analysis of distributed deep learning frameworks for convolutional neural networksAnalysis of different learning rate schedulers for ResNet50 training, showing learning rate over epochs (a) and validation accuracy over batch size (b). Note the original learning rate LR of 0.025 is scaled with the number of GPUsBack to article page