2 citations · 3 across the 2 of their papers we have counts for
2 papers
cs.LG2025★ 1 cited
Llamba: Scaling Distilled Recurrent Models for Efficient Language Processing
Aviv Bick, Tobias Katsch, Nimit Sohoni +2
We introduce Llamba, a family of efficient recurrent language models distilled from Llama-3.x into the Mamba architecture. The series includes Llamba-1B, Llamba-3B, and Llamba-8B,…
cs.LG2023★ 2 cited
GateLoop: Fully Data-Controlled Linear Recurrence for Sequence Modeling
Tobias Katsch
Linear Recurrence has proven to be a powerful tool for modeling long sequences efficiently. In this work, we show that existing models fail to take full advantage of its potential.…