Matryoshka Model Learning for Improved Elastic Student Models

Chetan Verma, Aditya Srinivas Timmaraju, Cho-Jui Hsieh +7

Industry-grade ML models are carefully designed to meet rapidly evolving serving constraints, which requires significant resources for model development. In this paper, we propose…