2 citations · 2 across the 9 of their papers we have counts for
3 papers · 2 filters
Stochastic Gradient Descent with Momentum: Analysis and Synthesis via Integral Quadratic Constraints
Dennis Gramlich, Carsten W. Scherer, Christian Ebenbauer
This article applies dynamic integral quadratic constraints (IQCs) to the analysis and synthesis of accelerated stochastic gradient algorithms. We consider composite objective func…
Structure, Analysis, and Synthesis of First-Order Algorithms
Jared Miller, Carsten Scherer, Fabian Jakob +1
First-order optimization algorithms can be interpreted through the lens of dynamical systems as the interconnection of linear systems and a set of subgradient nonlinearities. This…
Global Stability and Step Size Robustness of RMSProp
Naum Dimitrieski, Maria Christine Honecker, Carsten Scherer +1
In this paper, an input-to-state Lyapunov function for the RMSProp optimization algorithm is introduced. Global asymptotic stability of the RMSProp algorithm for constant step size…