AdaPerceiver: Transformers with Adaptive Width, Depth, and Tokens

Purvish Jajal, Nick John Eliopoulos, Benjamin Shiue-Hal Chou +3

Modern transformer architectures achieve remarkable performance across tasks and domains but remain rigid in how they allocate computation at inference time. Real-world deployment…