124 citations · 1.6k across the 112 of their papers we have counts for
118 papers
One Size Does Not Fit All: Curvature-Aware Adaptive Perturbation for SAM
Alessia Rossi, Felipe Campelo, Gabriel L. Oliveira
Poor generalisation in deep neural networks is frequently associated with convergence to sharp minima. Sharpness-Aware Minimisation (SAM) improves generalisation of deep neural net…
Oracle-Efficient Online Classification with Stochastic Inputs and Adversarial Outputs
Gon Buzaglo, Elad Hazan
We consider binary prediction with i.i.d. contexts from an unknown distribution and adaptively chosen losses. We show that a simple Follow-the-Perturbed-Leader algorithm using a Ga…
A Linearly Convergent Projection-Free Algorithm for Smooth Convex Sets
Elad Hazan
We consider minimizing a smooth, strongly convex function over a convex set. Projected gradient descent is known to converge linearly in this setting, but each iteration requires a…
Spectral Distillation: From Nonlinear Dynamics to Linear State-Space Models
Liane Galanti, Devan Shah, Shlomo Fortgang +1
Can nonlinear dynamical systems be learned through a compact linear state-space representation, without directly solving a non-convex system-identification problem? We give a prova…
Measuring Intelligence Beyond Human Scale
Jerry Han, Rafael Moschopoulos, Ella Colby +6
How can we measure intelligence beyond human capability? Human-authored benchmarks saturate, and above human capability, examiners may not know which tasks are both hard and verifi…
A Memory Efficient Unified Algorithm for Online Learning of Linear Dynamical Systems
Yuval Ran-Milo, Angelos Assos, Elad Hazan
Motivated by the challenge of stabilizing a general unknown linear dynamical system (LDS) from observations, we study the natural prerequisite of online prediction. Our goal is to…