1 citations · 1 across the 6 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Optimal Learning Rate Scaling Depends on Data in Deep Scalar Linear Networks
Yedi Zhang, Peter E. Latham, Leena Chennuru Vankadara +1
In this short note we consider the gradient descent dynamics of deep scalar linear networks, , which enjoy exact time-course solutions for any integer d…
cs.LG2026
To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters
Sara Dragutinović, Yedi Zhang, Rajesh Ranganath
While Adam has long been the ubiquitous default optimizer for deep neural networks, Muon has recently seen rapid adoption due to its superior training speed. Although much of the l…