Implicit Generative Copulas

Abstract

Copulas are a powerful tool for modeling multivariate distributions as they allow to separately estimate the univariate marginal distributions and the joint dependency structure. However, known parametric copulas offer limited flexibility especially in high dimensions, while commonly used non-parametric methods suffer from the curse of dimensionality. A popular remedy is to construct a tree-based hierarchy of conditional bivariate copulas. In this paper, we propose a flexible, yet conceptually simple alternative based on implicit generative neural networks. The key challenge is to ensure marginal uniformity of the estimated copula distribution. We achieve this by learning a multivariate latent distribution with unspecified marginals but the desired dependency structure. By applying the probability integral transform, we can then obtain samples from the high-dimensional copula distribution without relying on parametric assumptions or the need to find a suitable tree structure. Experiments on synthetic and real data from finance, physics, and image generation demonstrate the performance of this approach.

Accepted at NeurIPS 2021

References in corpus (11)

• Auto-Encoding Variational Bayes
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Equivalence of distance-based and RKHS-based statistics in hypothesis testing
• Generative Moment Matching Networks
• An empirical study on evaluation metrics of generative adversarial networks
• Training generative neural networks via Maximum Mean Discrepancy optimization
• Learning in Implicit Generative Models
• A Test of Relative Similarity For Model Selection in Generative Models
• A Universal Approximation Theorem of Deep Neural Networks for Expressing Probability Distributions
• Copulas as High-Dimensional Generative Models: Vine Copula Autoencoders
• Deep Archimedean Copulas