A Comparison of Optimization Algorithms for Deep Learning

Derya Soydaner

In recent years, we have witnessed the rise of deep learning. Deep neural networks have proved their success in many areas. However, the optimization of these networks has become m…