Dynamical Mean-Field Theory of Self-Attention Neural Networks

Ángel Poc-López, Miguel Aguilera

Transformer-based models have demonstrated exceptional performance across diverse domains, becoming the state-of-the-art solution for addressing sequential machine learning problem…