Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba

Yuchen Zou, Yineng Chen, Zuchao Li +2

Transformer, a deep neural network architecture, has long dominated the field of natural language processing and beyond. Nevertheless, the recent introduction of Mamba challenges i…