Improving the Robustness of Transformer-based Large Language Models with Dynamic Attention

Lujia Shen, Yuwen Pu, Shouling Ji +4

Transformer-based models, such as BERT and GPT, have been widely adopted in natural language processing (NLP) due to their exceptional performance. However, recent studies show the…