computer vision

Sequence-SOD: Bio-inspired Sequence-aware Spiking ObjectDetection for Event Cameras

arXiv:2607.26703 · doi:10.1007/s12559-026-10637-z

summary

The paper presents Sequence-SOD, a spiking neural network object detector for event cameras that processes continuous sequences of events while preserving membrane potentials, leading to improved detection performance and maintaining energy efficiency.

Abstract

Event cameras follow a retina-inspired sensing principle, reporting local intensity changes asynchronously with hightemporal resolution and a wide dynamic range. Spiking Neural Networks (SNNs) complement these sparse event streams through brain-inspired dynamics, using sparse spikes and leaky membrane potentials to integrate information over time. However, many SNN object detectors process isolated event intervals with a single label and reset the network state after each prediction, thereby underusing temporal information in continuous event streams. We introduce Sequence-SOD, a sequence-aware SNN object detector that processes extended event sequences containing labels at multiple time points. Events are accumulated into short intervals, discretized into temporal steps, and fed sequentially to an SSD-style Spiking DenseNet while preserving membrane potentials across intervals within a sequence, so that detection is driven by an evolving neural state instead of independently reset input windows. On the Gen1 Automotive Detection Dataset, sequence-aware training improves mAP from 23.38 for single-interval training to 25.30 without augmentation and to 26.88 withevent-data augmentation. The model achieves a theoretical prediction frequency of 40 Hz. Training and evaluating SNN object detectors on extended event sequences improves their ability to exploit temporal cues while preserving the energy-efficiency benefits of sparse spiking computation. The results highlight sequence-aware training as a complementary direction to architectural improvements for event-based SNN detection.

Topics & keywords

#event cameras#spiking neural networks#object detection#temporal sequence processing#energy-efficient computingSpiking DenseNetSSD-style detectorGen1 Automotive Detection Datasetmembrane potentialevent-data augmentation