48 citations · 62 across the 12 of their papers we have counts for
4 papers · 1 filter
Mamba with Hierarchical Memory: Solving Representation Bottleneck in Long Sequence Modeling
Qinwen Wang, Jieping Luo, Aoxiang Qin +5
Recurrent linear attention models (RLAs) such as Mamba offer efficient linear-time sequence modeling as an alternative to Transformers, yet their fixed-capacity recurrent states li…
MAR: Efficient Large Language Models via Module-aware Architecture Refinement
Junhong Cai, Guiqin Wang, Kejie Zhao +6
Large Language Models (LLMs) excel across diverse domains but suffer from high energy costs due to quadratic attention and dense Feed-Forward Network (FFN) operations. To address t…
Hebbian Learning with Global Direction
Wenjia Hua, Kejie Zhao, Luziwei Leng +3
Backpropagation algorithm has driven the remarkable success of deep neural networks, but its lack of biological plausibility and high computational costs have motivated the ongoing…
Towards Scalable GPU-Accelerated SNN Training via Temporal Fusion
Yanchen Li, Jiachun Li, Kebin Sun +2
Drawing on the intricate structures of the brain, Spiking Neural Networks (SNNs) emerge as a transformative development in artificial intelligence, closely emulating the complex dy…