Selection of sequence motifs and generative Hopfield-Potts models for protein familiesilies

Abstract

Statistical models for families of evolutionary related proteins have recently gained interest: in particular pairwise Potts models, as those inferred by the Direct-Coupling Analysis, have been able to extract information about the three-dimensional structure of folded proteins, and about the effect of amino-acid substitutions in proteins. These models are typically requested to reproduce the one- and two-point statistics of the amino-acid usage in a protein family, {\em i.e.}~to capture the so-called residue conservation and covariation statistics of proteins of common evolutionary origin. Pairwise Potts models are the maximum-entropy models achieving this. While being successful, these models depend on huge numbers of {\em ad hoc} introduced parameters, which have to be estimated from finite amount of data and whose biophysical interpretation remains unclear. Here we propose an approach to parameter reduction, which is based on selecting collective sequence motifs. It naturally leads to the formulation of statistical sequence models in terms of Hopfield-Potts models. These models can be accurately inferred using a mapping to restricted Boltzmann machines and persistent contrastive divergence. We show that, when applied to protein data, even 20-40 patterns are sufficient to obtain statistically close-to-generative models. The Hopfield patterns form interpretable sequence motifs and may be used to clusterize amino-acid sequences into functional sub-families. However, the distributed collective nature of these motifs intrinsically limits the ability of Hopfield-Potts models in predicting contact maps, showing the necessity of developing models going beyond the Hopfield-Potts models discussed here.

arXiv comment26 pages, 16 figures, to app. in PRE

References in corpus (11)

• Direct-coupling analysis of residue co-evolution captures native contacts across many protein families
• Identification of direct residue contacts in protein-protein interaction by message passing
• Improved contact prediction in proteins: Using pseudolikelihoods to infer Potts models
• Coevolutionary landscape inference and the context-dependence of mutations in beta-lactamase TEM-1
• Inverse statistical problems: from the inverse Ising problem to data science
• Inverse Statistical Physics of Protein Sequences: A Key Issues Review
• How pairwise coevolutionary models capture the collective residue variability in proteins
• Fast and accurate multivariate Gaussian modeling of protein families: Predicting residue contacts and protein-interaction partners
• From principal component to direct coupling analysis of coevolution in proteins: Low-eigenvalue modes are needed for structure prediction
• Large-scale identification of coevolution signals across homo-oligomeric protein interfaces by Direct Coupling Analysis
• Inter-residue, inter-protein and inter-family coevolution: bridging the scales

Cited by in corpus (14)

• Efficient generative modeling of protein sequences using simple autoregressive models
• Restricted Boltzmann Machine, recent advances and mean-field theory
• Generative Capacity of Probabilistic Protein Sequence Models
• Equilibrium and non-Equilibrium regimes in the learning of Restricted Boltzmann Machines
• Modeling sequence-space exploration and emergence of epistatic signals in protein evolution
• Sparse generative modeling via parameter-reduction of Boltzmann machines: application to protein-sequence families
• Learning a Restricted Boltzmann Machine using biased Monte Carlo sampling
• Disentangling representations in Restricted Boltzmann Machines without adversaries
• Bézier interpolation improves the inference of dynamical models from data
• Towards Parsimonious Generative Modeling of RNA Families
• The unbearable lightness of Restricted Boltzmann Machines: Theoretical Insights and Biological Applications
• Efficient training of energy-based models via spin-glass control
• Scaling Monte-Carlo-Based Inference on Antibody and TCR Repertoires
• Boltzmann machine learning and regularization methods for inferring evolutionary fields and couplings from a multiple sequence alignment