Large Language Models with At Most One Spike per Neuron

Zhuoya Zhao, Parsa Omidi, Aref Jafari +1

Leveraging their inherent sparse event-driven computation, spiking neural networks (SNNs) offer a promising path toward energy-efficient large language models (LLMs). Time-to-first…