Computationally Efficient Neural Receivers via Axial Self-Attention

Abstract

Deep learning-based neural receivers offer promising physical-layer solutions for next-generation wireless systems. We propose an axial self-attention transformer neural receiver that achieves state-of-the-art Block Error Rate (BLER) performance with significantly improved computational efficiency during inference and large-scale training. By factorizing attention operations along temporal and spectral axes, the proposed architecture reduces computational complexity from $O((TF{)}^2)$ to $O(T^{2}F+T{F}^2)$, yielding substantially fewer floating-point operations and attention matrix multiplications per transformer block. Experimental validation under 3GPP Clustered Delay Line (CDL) channels demonstrates consistent performance gains across varying mobility scenarios. Under non-line-of-sight conditions, our proposed axial neural receiver outperforms global self-attention and convolutional neural receiver baselines at 10% BLER and 1% BLER respectively, with reduced computational complexity.

Accepted to 2026 IEEE 27th International Workshop on Signal Processing and Artificial Intelligence in Wireless Communications (IEEE SPAWC 2026)

Topics & keywords