211 citations · 530 across the 27 of their papers we have counts for
4 papers · 1 filter
Scalable MatMul-free Language Modeling
Rui-Jie Zhu, Yu Zhang, Steven Abreu +7
Large Language Models (LLMs) have fundamentally altered how we approach scaling in machine learning. However, these models pose substantial computational and memory challenges, pri…
Autonomous Driving with Spiking Neural Networks
Rui-Jie Zhu, Ziqing Wang, Leilani Gilpin +1
Autonomous driving demands an integrated approach that encompasses perception, prediction, and planning, all while operating under strict energy constraints to enhance scalability…
Advancing Spiking Neural Networks towards Multiscale Spatiotemporal Interaction Learning
Yimeng Shan, Malu Zhang, Rui-jie Zhu +3
Recent advancements in neuroscience research have propelled the development of Spiking Neural Networks (SNNs), which not only have the potential to further advance neuroscience res…
SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks
Sreyes Venkatesh, Razvan Marinescu, Jason K. Eshraghian
Weight quantization is used to deploy high-performance deep learning models on resource-limited hardware, enabling the use of low-precision integers for storage and computation. Sp…