Correlation-Compressed Direct Coupling Analysis

Abstract

Learning Ising or Potts models from data has become an important topic in statistical physics and computational biology, with applications to predictions of structural contacts in proteins and other areas of biological data analysis. The corresponding inference problems are challenging since the normalization constant (partition function) of the Ising/Potts distributions cannot be computed efficiently on large instances. Different ways to address this issue have hence given size to a substantial methodological literature. In this paper we investigate how these methods could be used on much larger datasets than studied previously. We focus on a central aspect, that in practice these inference problems are almost always severely under-sampled, and the operational result is almost always a small set of leading (largest) predictions. We therefore explore an approach where the data is pre-filtered based on empirical correlations, which can be computed directly even for very large problems. Inference is only used on the much smaller instance in a subsequent step of the analysis. We show that in several relevant model classes such a combined approach gives results of almost the same quality as the computationally much more demanding inference on the whole dataset. We also show that results on whole-genome epistatic couplings that were obtained in a recent computation-intensive study can be retrieved by the new approach. The method of this paper hence opens up the possibility to learn parameters describing pair-wise dependencies in whole genomes in a computationally feasible and expedient manner.

arXiv comment15 pages, including 11 figures

References in corpus (22)

• Weak pairwise correlations imply strongly correlated network states in a neural population
• Direct-coupling analysis of residue co-evolution captures native contacts across many protein families
• Identification of direct residue contacts in protein-protein interaction by message passing
• Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
• Quantification of the effect of mutations using a global probability model of natural sequence variation
• Improved contact prediction in proteins: Using pseudolikelihoods to infer Potts models
• High-dimensional Ising model selection using ${\ell }_1$-regularized logistic regression
• Coevolutionary landscape inference and the context-dependence of mutations in beta-lactamase TEM-1
• Inverse statistical problems: from the inverse Ising problem to data science
• Inverse Statistical Physics of Protein Sequences: A Key Issues Review
• Fast pseudolikelihood maximization for direct-coupling analysis of protein structure from many homologous amino-acid sequences
• Pairwise maximum entropy models for studying large biological systems: when they can and when they can't work
• Inverse Ising inference using all the data
• Simultaneous identification of specifically interacting paralogs and inter-protein contacts by Direct-Coupling Analysis
• Statistical physics of pairwise probability models
• Small-correlation expansions for the inverse Ising problem
• Direct-Coupling Analysis of nucleotide coevolution facilitates RNA secondary and tertiary structure prediction
• Large-scale identification of coevolution signals across homo-oligomeric protein interfaces by Direct Coupling Analysis
• Improving contact prediction along three dimensions
• Learning with hidden variables
• Inference for dynamics of continuous variables: the Extended Plefka Expansion with hidden nodes
• Statistical mechanics of the inverse Ising problem and the optimal objective function

Cited by in corpus (4)

• Sparse generative modeling via parameter-reduction of Boltzmann machines: application to protein-sequence families
• Inference of compressed Potts graphical models
• Inferring genetic fitness from genomic data
• adabmDCA: Adaptive Boltzmann machine learning for biological sequences