Efficient Adaptive Transformer: An Empirical Study and Reproducible Framework

Jan Miller

The Efficient Adaptive Transformer (EAT) framework unifies three adaptive efficiency techniques - progressive token pruning, sparse attention, and dynamic early exiting - into a si…