Feedback Learning for Improving the Robustness of Neural Networks

Abstract

Recent research studies revealed that neural networks are vulnerable to adversarial attacks. State-of-the-art defensive techniques add various adversarial examples in training to improve models' adversarial robustness. However, these methods are not universal and can't defend unknown or non-adversarial evasion attacks. In this paper, we analyze the model robustness in the decision space. A feedback learning method is then proposed, to understand how well a model learns and to facilitate the retraining process of remedying the defects. The evaluations according to a set of distance-based criteria show that our method can significantly improve models' accuracy and robustness against different types of evasion attacks. Moreover, we observe the existence of inter-class inequality and propose to compensate it by changing the proportions of examples generated in different classes.

arXiv commentAccepted by ICMLA 2019

References in corpus (7)

• Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
• The Space of Transferable Adversarial Examples
• Technical Report on the CleverHans v2.1.0 Adversarial Examples Library
• Fractional Max-Pooling
• Adversarial Examples: Attacks and Defenses for Deep Learning
• Boosting Adversarial Attacks with Momentum
• Image Authentication Based on Neural Networks