Adaptive inference and function vectors in deep transformers

Ravin Raj, Gautam Reddy

Transformers are widely used as a general-purpose substrate for learning complex correlations between a large collection of coupled variables, but their internal mechanisms have re…