3 papers
cs.NE2025
Spatio-Temporal Pruning for Compressed Spiking Large Language Models
Yi Jiang, Malyaban Bal, Brian Matejek +3
Large Language Models (LLMs) present significant challenges for deployment in energy-constrained environments due to their large model sizes and high inference latency. Spiking Neu…
cs.NE2024
Scaling SNNs Trained Using Equilibrium Propagation to Convolutional Architectures
Jiaqi Lin, Malyaban Bal, Abhronil Sengupta
Equilibrium Propagation (EP) is a biologically plausible local learning algorithm initially developed for convergent recurrent neural networks (RNNs), where weight updates rely sol…
cs.NE2024
Exploring Extreme Quantization in Spiking Language Models
Malyaban Bal, Yi Jiang, Abhronil Sengupta
Despite the growing prevalence of large language model (LLM) architectures, a crucial concern persists regarding their energy and power consumption, which still lags far behind the…