Adaptive Pruning of Pretrained Transformer via Differential Inclusions

Yizhuo Ding, Ke Fan, Yikai Wang +2

Large transformers have demonstrated remarkable success, making it necessary to compress these models to reduce inference costs while preserving their perfor-mance. Current compres…