SMM Transformer: Leveraging Spiking Neural Networks for Multimodal Tasks

Xiubo Liang, Jinxing Han, Yuke Li +3

Spiking Neural Networks (SNNs) enable event-driven computation with sparse activations, but building multimodal Transformers on SNNs is hindered by unstable training in deep spikin…