Optimizers - A comparison

My simple comparison of the Adam, Adadelta and SGD optimizers used in a CNN based MNIST classifier.

Visualizing Accuracy and Loss *:

1. SGD OPTIMIZER

2. ADAM OPTIMIZER

3. ADADELTA OPTIMIZER

* Tuning the right hyperparams and altering the number of epochs and batch size could improve results vastly.