Multivariate-Information Adversarial Ensemble for Scalable Joint Distribution Matching

Abstract

A broad range of cross-$m$-domain generation researches boil down to matching a joint distribution by deep generative models (DGMs). Hitherto algorithms excel in pairwise domains while as $m$ increases, remain struggling to scale themselves to fit a joint distribution. In this paper, we propose a domain-scalable DGM, i.e., MMI-ALI for $m$-domain joint distribution matching. As an $m$-domain ensemble model of ALIs \cite{dumoulin2016adversarially}, MMI-ALI is adversarially trained with maximizing Multivariate Mutual Information (MMI) w.r.t. joint variables of each pair of domains and their shared feature. The negative MMIs are upper bounded by a series of feasible losses that provably lead to matching $m$-domain joint distributions. MMI-ALI linearly scales as $m$ increases and thus, strikes a right balance between efficacy and scalability. We evaluate MMI-ALI in diverse challenging $m$-domain scenarios and verify its superiority.

ICML-19

References in corpus (15)

• Deep Residual Learning for Image Recognition
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
• Improved Techniques for Training GANs
• Adversarial Feature Learning
• Adversarially Learned Inference
• Learning What and Where to Draw
• Video-to-Video Synthesis
• Geometry Score: A Method For Comparing Generative Adversarial Networks
• StarGAN-VC: Non-parallel many-to-many voice conversion with star generative adversarial networks
• Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesis
• JointGAN: Multi-Domain Joint Distribution Learning with Generative Adversarial Nets
• Hierarchical Adversarially Learned Inference
• MojiTalk: Generating Emotional Responses at Scale
• Modular Generative Adversarial Networks