Learning Structured Sparsity for Large Models: Bridging Model Compressibility and Efficient Inference

Tianxiang Xia, Kai Lion, Niao He +3

Scaling laws continue to reward increases in model scale, while the resulting computational and memory demands drive greater reliance on cloud infrastructure for inference. Yet unr…