5 papers
CLASP: Class-Adaptive Layer Fusion and Dual-Stage Pruning for Multimodal Large Language Models
Yunkai Dang, Yizhu Jiang, Yifan Jiang +4
Multimodal Large Language Models (MLLMs) suffer from substantial computational overhead due to the high redundancy in visual token sequences. Existing approaches typically address…
StochEP: Stochastic Equilibrium Propagation for Spiking Convergent Recurrent Neural Networks
Jiaqi Lin, Yi Jiang, Abhronil Sengupta
Spiking Neural Networks (SNNs) promise energy-efficient, sparse, biologically inspired computation. Training them with Backpropagation Through Time (BPTT) and surrogate gradients a…
Spatio-Temporal Pruning for Compressed Spiking Large Language Models
Yi Jiang, Malyaban Bal, Brian Matejek +3
Large Language Models (LLMs) present significant challenges for deployment in energy-constrained environments due to their large model sizes and high inference latency. Spiking Neu…
Exploring Extreme Quantization in Spiking Language Models
Malyaban Bal, Yi Jiang, Abhronil Sengupta
Despite the growing prevalence of large language model (LLM) architectures, a crucial concern persists regarding their energy and power consumption, which still lags far behind the…
Stochastic Spiking Neural Networks with First-to-Spike Coding
Yi Jiang, Sen Lu, Abhronil Sengupta
Spiking Neural Networks (SNNs), recognized as the third generation of neural networks, are known for their bio-plausibility and energy efficiency, especially when implemented on ne…