Tiny Models are the Computational Saver for Large Models

Qingyuan Wang, Barry Cardiff, Antoine Frappé +2

This paper introduces TinySaver, an early-exit-like dynamic model compression approach which employs tiny models to substitute large models adaptively. Distinct from traditional co…