Zeyuan Allen-Zhu

activity

20102025

most citedLoRA: Low-Rank Adaptation of Large Language Models

2.5k citations · 4.7k across the 60 of their papers we have counts for

collaborators

Showing 2017 · math.OCShow all

2 papers · 2 filters

math.OC2017★ 51 cited

Natasha 2: Faster Non-Convex Optimization Than SGD

Zeyuan Allen-Zhu

We design a stochastic algorithm to train any smooth neural network to $ε$ -approximate local minima, using $O (ε^{- 3.25})$ backpropagations. The best result was…

math.OC2017★ 34 cited

Natasha: Faster Non-Convex Stochastic Optimization Via Strongly Non-Convex Parameter

Zeyuan Allen-Zhu

Given a nonconvex function that is an average of $n$ smooth functions, we design stochastic first-order methods to find its approximate stationary points. The convergence of our ne…