activity
20062026
most citedOn the Optimization of Deep Networks: Implicit Acceleration by Overparameterization

124 citations · 1.6k across the 112 of their papers we have counts for

collaborators
Showing 2019Show all

12 papers · 1 filter

cs.LG2019★ 9 cited

The Nonstochastic Control Problem

Elad Hazan, Sham M. Kakade, Karan Singh

We consider the problem of controlling an unknown linear dynamical system in the presence of (nonstochastic) adversarial perturbations and adversarial convex loss functions. In con…

cs.LG2019★ 5 cited

The gradient complexity of linear regression

Mark Braverman, Elad Hazan, Max Simchowitz +1

We investigate the computational complexity of several basic linear algebra primitives, including largest eigenvector computation and linear regression, in the computational model…

cs.LG2019★ 51 cited

Logarithmic Regret for Online Control

Naman Agarwal, Elad Hazan, Karan Singh

We study optimal regret bounds for control in linear dynamical systems under adversarially changing strongly convex cost functions, given the knowledge of transition dynamics. This…

cs.LG2019★ 3 cited

Lecture Notes: Optimization for Machine Learning

Elad Hazan

Lecture notes on optimization for machine learning, derived from a course at Princeton University and tutorials given in MLSS, Buenos Aires, as well as Simons Foundation, Berkeley.

cs.LG2019

Introduction to Online Convex Optimization

Elad Hazan

This manuscript portrays optimization as a process. In many practical applications the environment is so complex that it is infeasible to lay out a comprehensive theoretical model…

cs.LG2019★ 1 cited

Private Learning Implies Online Learning: An Efficient Reduction

Alon Gonen, Elad Hazan, Shay Moran

We study the relationship between the notions of differentially private learning and online learning in games. Several recent works have shown that differentially private learning…