6 papers
SpikingNav: Robust Embodied Navigation with Spiking Neural Policies
Jiahong Zhang, Sijun Shen, Dehua Wu +5
Embodied navigation requires an agent to make sequential decisions from egocentric observations in a physical environment. Existing Artificial Neural Network (ANN)-based navigation…
Spiking Neural Networks for fMRI-Based Visual Semantic Decoding
Jiahong Zhang, Jinning Zhao, Sijun Shen +3
Functional magnetic resonance imaging (fMRI)-based visual decoding aims to recover visual information from measured brain activity, commonly by mapping fMRI responses into latent v…
Beyond Transformers: Linear Attention Policy for Open-Vocabulary Object Goal Navigation
Jiahong Zhang, Yifan Lin, Yandong Zhang +6
Open-Vocabulary Object Goal Navigation (OVON) requires agents to operate under partial observability, making effective internal state updates critical for navigation performance. T…
Burst Spiking Neural Networks
Jiahong Zhang, Sijun Shen, Man Yao +5
A central goal of current Spiking Neural Network (SNN) research is to improve their accuracy toward becoming low-power alternatives to Artificial Neural Networks (ANNs). This work…
SpikeMLLM: Spike-based Multimodal Large Language Models via Modality-Specific Temporal Scales and Temporal Compression
Han Xu, Zhiyong Qin, Di Shang +6
Multimodal Large Language Models (MLLMs) have achieved remarkable progress but incur substantial computational overhead and energy consumption during inference, limiting deployment…
Spike-driven Large Language Model
Han Xu, Xuerui Qiu, Baiyu Chen +7
Current Large Language Models (LLMs) are primarily based on large-scale dense matrix multiplications. Inspired by the brain's information processing mechanism, we explore the funda…