4 papers
Instinct vs. Reflection: Unifying Token and Verbalized Confidence in Multimodal Large Models
Yunkai Dang, Yifan Jiang, Yizhu Jiang +3
Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in various perception and reasoning tasks. Despite this success, ensuring their reliability in p…
CLASP: Class-Adaptive Layer Fusion and Dual-Stage Pruning for Multimodal Large Language Models
Yunkai Dang, Yizhu Jiang, Yifan Jiang +4
Multimodal Large Language Models (MLLMs) suffer from substantial computational overhead due to the high redundancy in visual token sequences. Existing approaches typically address…
StochEP: Stochastic Equilibrium Propagation for Spiking Convergent Recurrent Neural Networks
Jiaqi Lin, Yi Jiang, Abhronil Sengupta
Spiking Neural Networks (SNNs) promise energy-efficient, sparse, biologically inspired computation. Training them with Backpropagation Through Time (BPTT) and surrogate gradients a…
Spatio-Temporal Pruning for Compressed Spiking Large Language Models
Yi Jiang, Malyaban Bal, Brian Matejek +3
Large Language Models (LLMs) present significant challenges for deployment in energy-constrained environments due to their large model sizes and high inference latency. Spiking Neu…