Matryoshka Representation Learning

Aditya Kusupati, Gantavya Bhatt, Aniket Rege +8

Learned representations are a central component in modern ML systems, serving a multitude of downstream tasks. When training such representations, it is often the case that computa…