Return of the Encoder: Maximizing Parameter Efficiency for SLMs

Mohamed Elfeki, Rui Liu, Chad Voegele

The dominance of large decoder-only language models has overshadowed encoder-decoder architectures, despite their fundamental efficiency advantages in sequence processing. For smal…