1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.LG2024
A New Perspective on Shampoo's Preconditioner
Depen Morwani, Itai Shapira, Nikhil Vyas +3
Shampoo, a second-order optimization algorithm which uses a Kronecker product preconditioner, has recently garnered increasing attention from the machine learning community. The pr…
cs.LG2023★ 1 cited
Simplicity Bias in 1-Hidden Layer Neural Networks
Depen Morwani, Jatin Batra, Prateek Jain +1
Recent works have demonstrated that neural networks exhibit extreme simplicity bias(SB). That is, they learn only the simplest features to solve a task at hand, even in the presenc…