40 citations · 106 across the 28 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.CV2022★ 7 cited
Vision Transformers provably learn spatial structure
Samy Jelassi, Michael E. Sander, Yuanzhi Li
Vision Transformers (ViTs) have achieved comparable or superior performance than Convolutional Neural Networks (CNNs) in computer vision. This empirical breakthrough is even more r…
cs.LG2022
Dissecting adaptive methods in GANs
Samy Jelassi, David Dobre, Arthur Mensch +2
Adaptive methods are a crucial component widely used for training generative adversarial networks (GANs). While there has been some work to pinpoint the "marginal value of adaptive…
cs.LG2022★ 7 cited
Towards understanding how momentum improves generalization in deep learning
Samy Jelassi, Yuanzhi Li
Stochastic gradient descent (SGD) with momentum is widely used for training modern deep learning architectures. While it is well-understood that using momentum can lead to faster c…