DYNAMAX: Dynamic computing for Transformers and Mamba based architectures

Miguel Nogales, Matteo Gambella, Manuel Roveri

Early exits (EEs) offer a promising approach to reducing computational costs and latency by dynamically terminating inference once a satisfactory prediction confidence on a data sa…