383 citations · 773 across the 39 of their papers we have counts for
6 papers · 1 filter
Analysis of Biased Stochastic Gradient Descent Using Sequential Semidefinite Programs
Bin Hu, Peter Seiler, Laurent Lessard
We present a convergence rate analysis for biased stochastic gradient descent (SGD), where individual gradient updates are corrupted by computation errors. We develop stochastic qu…
A Robust Accelerated Optimization Algorithm for Strongly Convex Functions
Saman Cyrus, Bin Hu, Bryan Van Scoy +1
This work proposes an accelerated first-order algorithm we call the Robust Momentum Method for optimizing smooth strongly convex functions. The algorithm has a single scalar parame…
Dissipativity Theory for Nesterov's Accelerated Method
Bin Hu, Laurent Lessard
In this paper, we adapt the control theoretic concept of dissipativity theory to provide a natural understanding of Nesterov's accelerated method. Our theory ties rigorous converge…
Exponential Stability Analysis via Integral Quadratic Constraints
Ross Boczar, Laurent Lessard, Andrew Packard +1
The theory of integral quadratic constraints (IQCs) allows verification of stability and gain-bound properties of systems containing nonlinear or uncertain elements. Gain bounds of…
Control Interpretations for First-Order Optimization Methods
Bin Hu, Laurent Lessard
First-order iterative optimization methods play a fundamental role in large scale optimization and machine learning. This paper presents control interpretations for such optimizati…
Enhancing human color vision by breaking binocular redundancy
Bradley S. Gundlach, Michel Frising, Alireza Shahsafi +6
To see color, the human visual system combines the response of three types of cone cells in the retina--a compressive process that discards a significant amount of spectral informa…