Standard Transformers Achieve the Minimax Rate in Nonparametric Regression with $C^{s,\lambda }$ Targets

Yanming Lai, Defeng Sun

The tremendous success of Transformer models in fields such as large language models and computer vision necessitates a rigorous theoretical investigation. To the best of our knowl…