226 citations · 1.9k across the 128 of their papers we have counts for
6 papers · 1 filter
Cross-fluctuation phase transitions reveal sampling dynamics in diffusion models
Sai Niranjan Ramachandran, Manish Krishan Lal, Suvrit Sra
We analyse how the sampling dynamics of distributions evolve in score-based diffusion models using cross-fluctuations, a centered-moment statistic from statistical physics. Specifi…
Improved Rates for Stochastic Variance-Reduced Difference-of-Convex Algorithms
Anh Duc Nguyen, Alp Yurtsever, Suvrit Sra +1
In this work, we propose and analyze DCA-PAGE, a novel algorithm that integrates the difference-of-convex algorithm (DCA) with the ProbAbilistic Gradient Estimator (PAGE) to solve…
Linearly Convergent Algorithms for Nonsmooth Problems with Unknown Smooth Regions
Zhe Zhang, Suvrit Sra
We develop efficient algorithms for optimizing piecewise smooth (PWS) functions when their smooth regions are \emph{unknown} to the algorithm. For convex PWS functions satisfying a…
A projection-based framework for gradient-free and parallel learning
Andreas Bergmeister, Manish Krishan Lal, Stefanie Jegelka +1
We present a feasibility-seeking approach to neural network training. This mathematical optimization framework is distinct from conventional gradient-based loss minimization and us…
Revisiting Frank-Wolfe for Structured Nonconvex Optimization
Hoomaan Maskan, Yikun Hou, Suvrit Sra +1
We introduce a new projection-free (Frank-Wolfe) method for optimizing structured nonconvex functions that are expressed as a difference of two convex functions. This problem class…
Implicit Bias in Matrix Factorization and its Explicit Realization in a New Architecture
Yikun Hou, Suvrit Sra, Alp Yurtsever
Gradient descent for matrix factorization exhibits an implicit bias toward approximately low-rank solutions. While existing theories often assume the boundedness of iterates, empir…