One-stop Training of Multiple Capacity Models

Lan Jiang, Haoyang Huang, Dongdong Zhang +2

Training models with varying capacities can be advantageous for deploying them in different scenarios. While high-capacity models offer better performance, low-capacity models requ…