Transferability of Adversarial Examples to Attack Cloud-based Image Classifier Service

Abstract

In recent years, Deep Learning(DL) techniques have been extensively deployed for computer vision tasks, particularly visual classification problems, where new algorithms reported to achieve or even surpass the human performance. While many recent works demonstrated that DL models are vulnerable to adversarial examples. Fortunately, generating adversarial examples usually requires white-box access to the victim model, and real-world cloud-based image classification services are more complex than white-box classifier,the architecture and parameters of DL models on cloud platforms cannot be obtained by the attacker. The attacker can only access the APIs opened by cloud platforms. Thus, keeping models in the cloud can usually give a (false) sense of security. In this paper, we mainly focus on studying the security of real-world cloud-based image classification services. Specifically, (1) We propose a novel attack method, Fast Featuremap Loss PGD (FFL-PGD) attack based on Substitution model, which achieves a high bypass rate with a very limited number of queries. Instead of millions of queries in previous studies, our method finds the adversarial examples using only two queries per image; and (2) we make the first attempt to conduct an extensive empirical study of black-box attacks against real-world cloud-based classification services. Through evaluations on four popular cloud platforms including Amazon, Google, Microsoft, Clarifai, we demonstrate that FFL-PGD attack has a success rate over 90\% among different classification services. (3) We discuss the possible defenses to address these security challenges in cloud-based classification services. Our defense technology is mainly divided into model training stage and image preprocessing stage.

Accepted by Defcon China 2019. arXiv admin note: substantial text overlap with arXiv:1906.07997

References in corpus (9)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Models
• An Analysis of Deep Neural Network Models for Practical Applications
• A study of the effect of JPG compression on adversarial images
• Practical Black-Box Attacks against Machine Learning
• Advbox: a toolbox to generate adversarial examples that fool neural networks
• Query-Efficient Black-box Adversarial Examples (superceded)
• Google's Cloud Vision API Is Not Robust To Noise
• Attacking and Defending Machine Learning Applications of Public Cloud

Cited by in corpus (7)

• Advbox: a toolbox to generate adversarial examples that fool neural networks
• PatchAttack: A Black-box Texture-based Attack with Reinforcement Learning
• Attacking and Defending Machine Learning Applications of Public Cloud
• Adversarial Transferability in Wearable Sensor Systems
• Cloud-based Image Classification Service Is Not Robust To Simple Transformations: A Forgotten Battlefield
• Simple Transparent Adversarial Examples
• OFEI: A Semi-black-box Android Adversarial Sample Attack Framework Against DLaaS