Sharper Generalization Bounds for Transformer

Yawen Li, Tao Hu, Zhouhui Lian +4

This paper studies generalization error bounds for Transformer models. Based on the offset Rademacher complexity, we derive sharper generalization bounds for different Transformer…