Style transfer-based image synthesis as an efficient regularization technique in deep learning
arXiv:1905.10974
Abstract
These days deep learning is the fastest-growing area in the field of Machine Learning. Convolutional Neural Networks are currently the main tool used for image analysis and classification purposes. Although great achievements and perspectives, deep neural networks and accompanying learning algorithms have some relevant challenges to tackle. In this paper, we have focused on the most frequently mentioned problem in the field of machine learning, that is relatively poor generalization abilities. Partial remedies for this are regularization techniques e.g. dropout, batch normalization, weight decay, transfer learning, early stopping and data augmentation. In this paper, we have focused on data augmentation. We propose to use a method based on a neural style transfer, which allows generating new unlabeled images of a high perceptual quality that combine the content of a base image with the appearance of another one. In a proposed approach, the newly created images are described with pseudo-labels, and then used as a training dataset. Real, labeled images are divided into the validation and test set. We validated the proposed method on a challenging skin lesion classification case study. Four representative neural architectures are examined. Obtained results show the strong potential of the proposed approach.
6 pages, 4 figures, accepted to the 24th International Conference on Methods and Models in Automation and Robotics (MMAR 2019)
References in corpus (6)
- The Effectiveness of Data Augmentation in Image Classification using Deep Learning
- Random Erasing Data Augmentation
- Towards Deep Neural Network Architectures Robust to Adversarial Examples
- Fast Patch-based Style Transfer of Arbitrary Style
- Regularization for Deep Learning: A Taxonomy
- Data-Driven Color Augmentation Techniques for Deep Skin Image Analysis