activity
20142019
most citedThe Power of Normalization: Faster Evasion of Saddle Points

66 citations · 165 across the 6 of their papers we have counts for

collaborators

6 papers

math.OC201915 cited

UniXGrad: A Universal, Adaptive Algorithm with Optimal Guarantees for Constrained Optimization

Ali Kavis, Kfir Y. Levy, Francis Bach +1

We propose a novel adaptive, accelerated algorithm for the stochastic constrained convex optimization setting. Our method, which is inspired by the Mirror-Prox method, \emph{simult…

cs.LG20194 cited

Online Variance Reduction with Mixtures

Zalán Borsos, Sebastian Curi, Kfir Y. Levy +1

Adaptive importance sampling for stochastic optimization is a promising approach that offers improved convergence through variance reduction. In this work, we propose a new framewo…

cs.LG201918 cited

Multi-Player Bandits: The Adversarial Case

Pragnya Alatur, Kfir Y. Levy, Andreas Krause

We consider a setting where multiple players sequentially choose among a common set of actions (arms). Motivated by a cognitive radio networks application, we assume that players i…

cs.LG201928 cited

A Universal Algorithm for Variational Inequalities Adaptive to Smoothness and Noise

Francis Bach, Kfir Y. Levy

We consider variational inequalities coming from monotone operators, a setting that includes convex minimization and convex-concave saddle-point problems. We assume an access to po…

cs.LG201666 cited

The Power of Normalization: Faster Evasion of Saddle Points

Kfir Y. Levy

A commonly used heuristic in non-convex optimization is Normalized Gradient Descent (NGD) - a variant of gradient descent in which only the direction of the gradient is taken into…

cs.LG201434 cited

Logistic Regression: Tight Bounds for Stochastic and Online Optimization

Elad Hazan, Tomer Koren, Kfir Y. Levy

The logistic loss function is often advocated in machine learning and statistics as a smooth and strictly convex surrogate for the 0-1 loss. In this paper we investigate the questi…