Transformers Can Overcome the Curse of Dimensionality: A Theoretical Study from an Approximation Perspective

Yuling Jiao, Yanming Lai, Yang Wang +1

The Transformer model is widely used in various application areas of machine learning, such as natural language processing. This paper investigates the approximation of the Hölder…