Learning Discriminators as Energy Networks in Adversarial Learning

Abstract

We propose a novel framework for structured prediction via adversarial learning. Existing adversarial learning methods involve two separate networks, i.e., the structured prediction models and the discriminative models, in the training. The information captured by discriminative models complements that in the structured prediction models, but few existing researches have studied on utilizing such information to improve structured prediction models at the inference stage. In this work, we propose to refine the predictions of structured prediction models by effectively integrating discriminative models into the prediction. Discriminative models are treated as energy-based models. Similar to the adversarial learning, discriminative models are trained to estimate scores which measure the quality of predicted outputs, while structured prediction models are trained to predict contrastive outputs with maximal energy scores. In this way, the gradient vanishing problem is ameliorated, and thus we are able to perform inference by following the ascent gradient directions of discriminative models to refine structured prediction models. The proposed method is able to handle a range of tasks, e.g., multi-label classification and image segmentation. Empirical results on these two tasks validate the effectiveness of our learning method.

References in corpus (17)

• Adam: A Method for Stochastic Optimization
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Explaining and Harnessing Adversarial Examples
• Conditional Random Fields as Recurrent Neural Networks
• Progressive Growing of GANs for Improved Quality, Stability, and Variation
• Energy-based Generative Adversarial Network
• Unsupervised Image-to-Image Translation Networks
• Semantic Segmentation using Adversarial Networks
• Input Convex Neural Networks
• Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space
• Loss-Sensitive Generative Adversarial Networks on Lipschitz Densities
• Learning Deep Structured Models
• Training Deep Neural Networks via Direct Loss Minimization
• Deep Value Networks Learn to Evaluate and Iteratively Refine Structured Outputs
• Deep Learning for Semantic Part Segmentation with High-Level Guidance
• End-to-End Learning for Structured Prediction Energy Networks
• Image Segmentation by Iterative Inference from Conditional Score Estimation