DPFormer: Learning Differentially Private Transformer on Long-Tailed Data

Youlong Ding, Xueyang Wu, Hao Wang +1

The Transformer has emerged as a versatile and effective architecture with broad applications. However, it still remains an open problem how to efficiently train a Transformer mode…