Reinforcement Learning for Autonomous Defence in Software-Defined Networking

Abstract

Despite the successful application of machine learning (ML) in a wide range of domains, adaptability---the very property that makes machine learning desirable---can be exploited by adversaries to contaminate training and evade classification. In this paper, we investigate the feasibility of applying a specific class of machine learning algorithms, namely, reinforcement learning (RL) algorithms, for autonomous cyber defence in software-defined networking (SDN). In particular, we focus on how an RL agent reacts towards different forms of causative attacks that poison its training process, including indiscriminate and targeted, white-box and black-box attacks. In addition, we also study the impact of the attack timing, and explore potential countermeasures such as adversarial training.

arXiv comment20 pages, 8 figures

References in corpus (21)

• Explaining and Harnessing Adversarial Examples
• Playing Atari with Deep Reinforcement Learning
• Ensemble Adversarial Training: Attacks and Defenses
• Prioritized Experience Replay
• Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networks
• Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
• Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples
• Adversarial Feature Selection against Evasion Attacks
• Defensive Distillation is Not Robust to Adversarial Examples
• Keeping the Bad Guys Out: Protecting and Vaccinating Deep Learning with JPEG Compression
• Data Poisoning Attacks on Factorization-Based Collaborative Filtering
• Reinforcement Learning for Resource Provisioning in Vehicular Cloud
• Practical Black-Box Attacks against Machine Learning
• Universal adversarial perturbations
• Blocking Transferability of Adversarial Examples in Black-Box Learning Systems
• Improving the Robustness of Deep Neural Networks via Stability Training
• Certified Defenses for Data Poisoning Attacks
• Adversarial Example Defenses: Ensembles of Weak Defenses are not Strong
• Curie: A method for protecting SVM Classifier from Poisoning Attack
• Adversarial Examples Detection in Deep Networks with Convolutional Filter Statistics
• Adequacy of the Gradient-Descent Method for Classifier Evasion Attacks

Cited by in corpus (1)

• The Faults in Our Pi Stars: Security Issues and Open Challenges in Deep Reinforcement Learning