156 citations · 160 across the 3 of their papers we have counts for
3 papers
cs.CR2023★ 4 cited
Backdoor Attacks to Pre-trained Unified Foundation Models
Zenghui Yuan, Yixin Liu, Kai Zhang +2
The rise of pre-trained unified foundation models breaks down the barriers between different modalities and tasks, providing comprehensive support to users with unified architectur…
cs.AI2023★ 156 cited
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT
Ce Zhou, Qian Li, Chen Li +16
Pretrained Foundation Models (PFMs) are regarded as the foundation for various downstream tasks with different data modalities. A PFM (e.g., BERT, ChatGPT, and GPT-4) is trained on…
cs.CL2022
SEAT: Stable and Explainable Attention
Lijie Hu, Yixin Liu, Ninghao Liu +3
Currently, attention mechanism becomes a standard fixture in most state-of-the-art natural language processing (NLP) models, not only due to outstanding performance it could gain,…