Improving Energy Conserving Descent for Machine Learning: Theory and Practice

G. Bruno De Luca, Alice Gatti, Eva Silverstein

We develop the theory of Energy Conserving Descent (ECD) and introduce ECDSep, a gradient-based optimization algorithm able to tackle convex and non-convex optimization problems. T…