How do SGD hyperparameters in natural training affect adversarial robustness?

Sandesh Kamath, Amit Deshpande, K V Subrahmanyam

Learning rate, batch size and momentum are three important hyperparameters in the SGD algorithm. It is known from the work of Jastrzebski et al. arXiv:1711.04623 that large batch s…