1.1k citations · 1.2k across the 11 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023★ 1.1k cited
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Albert Gu, Tri Dao
Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many…
cs.CL2023
Augmenting conformers with structured state-space sequence models for online speech recognition
Haozhe Shan, Albert Gu, Zhong Meng +3
Online speech recognition, where the model only accesses context to the left, is an important and challenging use case for ASR systems. In this work, we investigate augmenting neur…