Adversarial Training with Large Step Sizes: Implicit Bias, Optimization, and Sharpness

Yi Feng, Andrea Paudice

Adversarial Training (AT) is an important method for improving model robustness. We study the dynamics of deterministic Gradient Descent (GD) in AT. Most existing works in this dir…