DINO: A Conditional Energy-Based GAN for Domain Translation
arXiv:2102.09281
Abstract
Domain translation is the process of transforming data from one domain to another while preserving the common semantics. Some of the most popular domain translation systems are based on conditional generative adversarial networks, which use source domain data to drive the generator and as an input to the discriminator. However, this approach does not enforce the preservation of shared semantics since the conditional input can often be ignored by the discriminator. We propose an alternative method for conditioning and present a new framework, where two networks are simultaneously trained, in a supervised manner, to perform domain translation in opposite directions. Our method is not only better at capturing the shared information between two domains but is more generic and can be applied to a broader range of problems. The proposed framework performs well even in challenging cross-modal translations, such as video-driven speech reconstruction, for which other systems struggle to maintain correspondence.
arXiv commentAccepted to ICLR 2021
References in corpus (13)
- Conditional Generative Adversarial Nets
- Instance Normalization: The Missing Ingredient for Fast Stylization
- Self-Attention Generative Adversarial Networks
- Generative Adversarial Text to Image Synthesis
- Conditional Image Synthesis With Auxiliary Classifier GANs
- Improved Techniques for Training GANs
- Energy-based Generative Adversarial Network
- BEGAN: Boundary Equilibrium Generative Adversarial Networks
- Deep multi-scale video prediction beyond mean square error
- Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks
- Variational Approaches for Auto-Encoding Generative Adversarial Networks
- Adversarial Audio Synthesis
- Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translation