ElastiFormer: Learned Redundancy Reduction in Transformer via Self-Distillation

Junzhang Liu, Tingkai Liu, Yueyuan Sui +1

We introduce ElastiFormer, a post-training technique that adapts pretrained Transformer models into an elastic counterpart with variable inference time compute. ElastiFormer introd…