activity
20062022
most citedTight Analyses for Non-Smooth Stochastic Gradient Descent

21 citations · 101 across the 20 of their papers we have counts for

collaborators

22 papers

cs.LG2022

Efficient and Optimal Fixed-Time Regret with Two Experts

Laura Greenstreet, Nicholas J. A. Harvey, Victor Sanches Portella

Prediction with expert advice is a foundational problem in online learning. In instances with rounds and experts, the classical Multiplicative Weights Update method suffers…

cs.LG2020★ 7 cited

Regret Bounds without Lipschitz Continuity: Online Learning with Relative-Lipschitz Losses

Yihan Zhou, Victor S. Portella, Mark Schmidt +1

In online convex optimization (OCO), Lipschitz continuity of the functions is commonly assumed in order to obtain sublinear regret. Moreover, many algorithms have only logarithmic…

cs.HC2020

LSQT: Low-Stretch Quasi-Trees for Bundling and Layout

Rebecca Vandenberg, Madison Elliott, Nicholas Harvey +1

We introduce low-stretch trees to the visualization community with LSQT, our novel technique that uses quasi-trees for both layout and edge bundling. Our method offers strong compu…

cs.LG2020★ 19 cited

Online mirror descent and dual averaging: keeping pace in the dynamic case

Huang Fang, Nicholas J. A. Harvey, Victor S. Portella +1

Online mirror descent (OMD) and dual averaging (DA) -- two fundamental algorithms for online convex optimization -- are known to have very similar (and sometimes identical) perform…

cs.LG2020

Optimal anytime regret with two experts

Nicholas J. A. Harvey, Christopher Liaw, Edwin Perkins +1

We consider the classical problem of prediction with expert advice. In the fixed-time setting, where the time horizon is known in advance, algorithms that achieve the optimal regre…

cs.LG2019★ 10 cited

Simple and optimal high-probability bounds for strongly-convex stochastic gradient descent

Nicholas J. A. Harvey, Christopher Liaw, Sikander Randhawa

We consider stochastic gradient descent algorithms for minimizing a non-smooth, strongly-convex function. Several forms of this algorithm, including suffix averaging, are known to…