First-Order Optimization as Minimum-Time Control

Liraz Mudrik, Isaac Kaminer, Pramod P. Khargonekar

We formulate first-order optimization as a minimum-time control problem. The iterate is the state, the update, a combination of the gradients observed so far, is the control, and t…