Adversarially Trained Linear Transformers Are Optimal Robust In-Context Learners for Gaussian Mixtures

Soichiro Kumano

Adversarial training is one of the most reliable defenses against adversarial attacks, but its high computational cost must generally be paid anew for each task. Robust foundation…