Break a Lag: Triple Exponential Moving Average for Enhanced Optimization

Roi Peleg, Yair Smadar, Teddy Lazebnik +1

The performance of deep learning models is critically dependent on sophisticated optimization strategies. While existing optimizers have shown promising results, many rely on first…