Train Faster, Perform Better: Modular Adaptive Training in Over-Parameterized Models

Yubin Shi, Yixuan Chen, Mingzhi Dong +10

Despite their prevalence in deep-learning communities, over-parameterized models convey high demands of computational costs for proper training. This work studies the fine-grained,…