Mahalanobis-Based Multi-Head Attention for Complex State Propagation

Xiaohe Li

In this paper, we propose \textbf{Mahalanobis-Based Multi-Head Attention} (MHA-CSP), a novel attention mechanism that replaces the standard dot-product with a \textbf{Mahalanobis d…