most citedSpikformer: When Spiking Neural Network Meets Transformer

105 citations · 217 across the 26 of their papers we have counts for

collaborators

26 papers

cs.CV2023★ 1 cited

Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline

Xiao Wang, Shiao Wang, Chuanming Tang +4

Tracking using bio-inspired event cameras has drawn more and more attention in recent years. Existing works either utilize aligned RGB and event data for accurate tracking or direc…

cs.IR2023★ 1 cited

Knowledge Prompt-tuning for Sequential Recommendation

Jianyang Zhai, Xiawu Zheng, Chang-Dong Wang +2

Pre-trained language models (PLMs) have demonstrated strong performance in sequential recommendation (SR), which are utilized to extract general knowledge. However, existing method…

cs.CV2023★ 9 cited

SSTFormer: Bridging Spiking Neural Network and Memory Support Transformer for Frame-Event based Recognition

Xiao Wang, Yao Rong, Zongzhen Wu +4

Event camera-based pattern recognition is a newly arising research topic in recent years. Current researchers usually transform the event streams into images, graphs, or voxels, an…

cs.LG2023

Learning Sparse Neural Networks with Identity Layers

Mingjian Ni, Guangyao Chen, Xiawu Zheng +3

The sparsity of Deep Neural Networks is well investigated to maximize the performance and reduce the size of overparameterized networks as possible. Existing methods focus on pruni…

cs.NE2023★ 35 cited

Spike-driven Transformer

Man Yao, Jiakui Hu, Zhaokun Zhou +4

Spiking Neural Networks (SNNs) provide an energy-efficient deep learning option due to their unique spike-based event-driven (i.e., spike-driven) paradigm. In this paper, we incorp…

cs.CV2023

Population-Based Evolutionary Gaming for Unsupervised Person Re-identification

Yunpeng Zhai, Peixi Peng, Mengxi Jia +4

Unsupervised person re-identification has achieved great success through the self-improvement of individual neural networks. However, limited by the lack of diversity of discrimina…

cs.NE2023★ 1 cited

Long-Range Feedback Spiking Network Captures Dynamic and Static Representations of the Visual Cortex under Movie Stimuli

Liwei Huang, Zhengyu Ma, Liutao Yu +2

Deep neural networks (DNNs) are widely used models for investigating biological visual representations. However, existing DNNs are mostly designed to analyze neural responses to st…

cs.NE2023

Auto-Spikformer: Spikformer Architecture Search

Kaiwei Che, Zhaokun Zhou, Zhengyu Ma +5

The integration of self-attention mechanisms into Spiking Neural Networks (SNNs) has garnered considerable interest in the realm of advanced deep learning, primarily due to their b…

cs.CV2023★ 1 cited

Album Storytelling with Iterative Story-aware Captioning and Large Language Models

Munan Ning, Yujia Xie, Dongdong Chen +5

This work studies how to transform an album to vivid and coherent stories, a task we refer to as "album storytelling". While this task can help preserve memories and facilitate exp…

cs.CV2023

Temporal Contrastive Learning for Spiking Neural Networks

Haonan Qiu, Zeyin Song, Yanqi Chen +6

Biologically inspired spiking neural networks (SNNs) have garnered considerable attention due to their low-energy consumption and spatio-temporal information processing capabilitie…

cs.LG2023★ 2 cited

Probabilistic Modeling: Proving the Lottery Ticket Hypothesis in Spiking Neural Network

Man Yao, Yuhong Chou, Guangshe Zhao +4

The Lottery Ticket Hypothesis (LTH) states that a randomly-initialized large neural network contains a small sub-network (i.e., winning tickets) which, when trained in isolation, c…

cs.NE2023★ 5 cited

Enhancing the Performance of Transformer-based Spiking Neural Networks by SNN-optimized Downsampling with Precise Gradient Backpropagation

Chenlin Zhou, Han Zhang, Zhaokun Zhou +5

Deep spiking neural networks (SNNs) have drawn much attention in recent years because of their low power consumption, biological rationality and event-driven property. However, sta…

cs.CV2023★ 6 cited

Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learning

Zeyin Song, Yifan Zhao, Yujun Shi +3

Few-shot class-incremental learning (FSCIL) aims at learning to classify new classes continually from limited samples without forgetting the old classes. The mainstream framework t…

cs.NE2023★ 15 cited

Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies

Wei Fang, Zhaofei Yu, Zhaokun Zhou +5

Vanilla spiking neurons in Spiking Neural Networks (SNNs) use charge-fire-reset neuronal dynamics, which can only be simulated serially and can hardly learn long-time dependencies.…

q-bio.NC2023

Deep Spiking Neural Networks with High Representation Similarity Model Visual Pathways of Macaque and Mouse

Liwei Huang, Zhengyu Ma, Liutao Yu +2

Deep artificial neural networks (ANNs) play a major role in modeling the visual pathways of primate and rodent. However, they highly simplify the computational properties of neuron…

cs.LG2023★ 6 cited

A Unified Framework for Soft Threshold Pruning

Yanqi Chen, Zhengyu Ma, Wei Fang +3

Soft threshold pruning is among the cutting-edge pruning methods with state-of-the-art performance. However, previous methods either perform aimless searching on the threshold sche…

cs.NE2023★ 9 cited

Training Full Spike Neural Networks via Auxiliary Accumulation Pathway

Guangyao Chen, Peixi Peng, Guoqi Li +1

Due to the binary spike signals making converting the traditional high-power multiply-accumulation (MAC) into a low-power accumulation (AC) available, the brain-inspired Spiking Ne…

cs.CV2023

MADAv2: Advanced Multi-Anchor Based Active Domain Adaptation Segmentation

Munan Ning, Donghuan Lu, Yujia Xie +6

Unsupervised domain adaption has been widely adopted in tasks with scarce annotated data. Unfortunately, mapping the target-domain distribution to the source-domain unconditionally…

cs.CV2022★ 1 cited

Unsupervised Deraining: Where Asymmetric Contrastive Learning Meets Self-similarity

Yi Chang, Yun Guo, Yuntong Ye +5

Most of the existing learning-based deraining methods are supervisedly trained on synthetic rainy-clean pairs. The domain gap between the synthetic and real rain makes them less ge…

cs.CV2022★ 2 cited

Meta Architecture for Point Cloud Analysis

Haojia Lin, Xiawu Zheng, Lijiang Li +5

Recent advances in 3D point cloud analysis bring a diverse set of network architectures to the field. However, the lack of a unified framework to interpret those networks makes any…

cs.CV2022★ 1 cited

Attention Spiking Neural Networks

Man Yao, Guangshe Zhao, Hengyu Zhang +5

Benefiting from the event-driven and sparse spiking characteristics of the brain, spiking neural networks (SNNs) are becoming an energy-efficient alternative to artificial neural n…

cs.NE2022★ 105 cited

Spikformer: When Spiking Neural Network Meets Transformer

Zhaokun Zhou, Yuesheng Zhu, Chao He +4

We consider two biologically plausible structures, the Spiking Neural Network (SNN) and the self-attention mechanism. The former offers an energy-efficient and event-driven paradig…

cs.CV2022★ 17 cited

Masked Autoencoders for Point Cloud Self-supervised Learning

Yatian Pang, Wenxiao Wang, Francis E. H. Tay +3

As a promising scheme of self-supervised learning, masked autoencoding has significantly advanced natural language processing and computer vision. Inspired by this, we propose a ne…

cs.CV2022

Training-free Transformer Architecture Search

Qinqin Zhou, Kekai Sheng, Xiawu Zheng +5

Recently, Vision Transformer (ViT) has achieved remarkable success in several computer vision tasks. The progresses are highly relevant to the architecture design, then it is worth…