SpecMamba: Accelerating Mamba Inference on FPGA with Speculative Decoding

Linfeng Zhong, Songqiang Xu, Huifeng Wen +4

The growing demand for efficient long-sequence modeling on edge devices has propelled widespread adoption of State Space Models (SSMs) like Mamba, due to their superior computation…