Do optimization methods in deep learning applications matter?

Buse Melis Ozyildirim, Mariam Kiran

With advances in deep learning, exponential data growth and increasing model complexity, developing efficient optimization methods are attracting much research attention. Several i…