2.6k citations · 3.1k across the 36 of their papers we have counts for
6 papers · 1 filter
Fast and Multiphase Rates for Nearest Neighbor Classifiers
Pengkun Yang, Jingzhao Zhang
We study the scaling of classification error rates with respect to the size of the training dataset. In contrast to classical results where rates are minimax optimal for a problem…
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles
Lesi Chen, Yaohua Ma, Jingzhao Zhang
In this work, we consider bilevel optimization when the lower-level problem is strongly convex. Recent works show that with a Hessian-vector product (HVP) oracle, one can provably…
Fast Conditional Mixing of MCMC Algorithms for Non-log-concave Distributions
Xiang Cheng, Bohan Wang, Jingzhao Zhang +1
MCMC algorithms offer empirically efficient tools for sampling from a target distribution . However, on the theory side, MCMC algorithms suffer from slow…
Online Control with Adversarial Disturbance for Continuous-time Linear Systems
Jingwei Li, Jing Dong, Can Chang +2
We study online control for continuous-time linear systems with finite sampling rates, where the objective is to design an online procedure that learns under non-stochastic noise a…
Lower Generalization Bounds for GD and SGD in Smooth Stochastic Convex Optimization
Peiyuan Zhang, Jiaye Teng, Jingzhao Zhang
This work studies the generalization error of gradient methods. More specifically, we focus on how training steps and step-size might affect generalization in smooth stocha…
On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis
Lesi Chen, Jing Xu, Jingzhao Zhang
Bilevel optimization reveals the inner structure of otherwise oblique optimization problems, such as hyperparameter tuning, neural architecture search, and meta-learning. A common…