2 papers
cs.LG2025
FAS: Fast ANN-SNN Conversion for Spiking Large Language Models
Long Chen, Xiaotian Song, Andy Song +3
Spiking Large Language Models have been shown as a good alternative to LLMs in various scenarios. Existing methods for creating Spiking LLMs, i.e., direct training and ANN-SNN conv…
cs.CV2024
MLP Can Be A Good Transformer Learner
Sihao Lin, Pumeng Lyu, Dongrui Liu +4
Self-attention mechanism is the key of the Transformer but often criticized for its computation demands. Previous token pruning works motivate their methods from the view of comput…