27 citations · 30 across the 3 of their papers we have counts for
3 papers
cs.LG2023★ 3 cited
MatFormer: Nested Transformer for Elastic Inference
Devvrit, Sneha Kudugunta, Aditya Kusupati +8
Foundation models are applied in a broad spectrum of settings with different inference constraints, from massive multi-accelerator clusters to resource-constrained standalone mobil…
cs.CV2022
Task-Customized Self-Supervised Pre-training with Scalable Dynamic Routing
Zhili Liu, Jianhua Han, Lanqing Hong +4
Self-supervised learning (SSL), especially contrastive methods, has raised attraction recently as it learns effective transferable representations without semantic annotations. A c…
cs.LG2022★ 27 cited
Matryoshka Representation Learning
Aditya Kusupati, Gantavya Bhatt, Aniket Rege +8
Learned representations are a central component in modern ML systems, serving a multitude of downstream tasks. When training such representations, it is often the case that computa…