Maximum entropy models for antibody diversity

Abstract

Recognition of pathogens relies on families of proteins showing great diversity. Here we construct maximum entropy models of the sequence repertoire, building on recent experiments that provide a nearly exhaustive sampling of the IgM sequences in zebrafish. These models are based solely on pairwise correlations between residue positions, but correctly capture the higher order statistical properties of the repertoire. Exploiting the interpretation of these models as statistical physics problems, we make several predictions for the collective properties of the sequence ensemble: the distribution of sequences obeys Zipf's law, the repertoire decomposes into several clusters, and there is a massive restriction of diversity due to the correlations. These predictions are completely inconsistent with models in which amino acid substitutions are made independently at each site, and are in good agreement with the data. Our results suggest that antibody diversity is not limited by the sequences encoded in the genome, and may reflect rapid adaptation to antigenic challenges. This approach should be applicable to the study of the global properties of other protein families.

References in corpus (3)

• Identification of direct residue contacts in protein-protein interaction by message passing
• Ising models for networks of real neurons
• Rediscovering the power of pairwise interactions

Cited by in corpus (123)

• Statistical mechanics for natural flocks of birds
• Are biological systems poised at criticality?
• Colloquium: Criticality and dynamical scaling in living systems
• Statistical inference of the generation probability of T-cell receptors from sequence repertoires
• Searching for collective behavior in a network of real neurons
• Inverse statistical problems: from the inverse Ising problem to data science
• Computational strategies for dissecting the high-dimensional complexity of adaptive immune repertoires
• Information-based fitness and the emergence of criticality in living systems
• Social interactions dominate speed control in driving natural flocks toward criticality
• Finite-size scaling as a way to probe near-criticality in natural swarms
• Inferring interaction partners from protein sequences
• How a well-adapted immune system is organized
• Quantifying selection in immune receptor repertoires
• Measuring the sequence-affinity landscape of antibodies with massively parallel titration curves
• Fast and accurate multivariate Gaussian modeling of protein families: Predicting residue contacts and protein-interaction partners
• Epigenetic landscapes explain partially reprogrammed cells and identify key reprogramming genes
• Zipf's law and criticality in multivariate data without fine-tuning
• The simplest maximum entropy model for collective behavior in a neural network
• Fluctuating fitness shapes the clone size distribution of immune repertoires
• Dissecting the Specificity of Protein-Protein Interaction in Bacterial Two-Component Signaling: Orphans and Crosstalks
• Towards the development of human immune-system-on-a-chip platforms
• Cancer-driven dynamics of immune cells in a microfluidic environment
• Maximum Caliber: a general variational principle for dynamical systems
• Dynamical criticality in the collective activity of a population of retinal neurons
• Complexity of waves in nonlinear disordered media
• Dynamical maximum entropy approach to flocking
• Searching for collective behavior in a small brain
• Genotype to phenotype mapping and the fitness landscape of the E. coli lac promoter
• Augmenting adaptive immunity: progress and challenges in the quantitative engineering and analysis of adaptive immune receptor repertoires
• Pseudolikelihood Decimation Algorithm Improving the Inference of the Interaction Network in a General Class of Ising Models
• Quantitative Immunology for Physicists
• Physical epistatic landscape of antibody binding affinity
• Statistical mechanics for metabolic networks during steady-state growth
• The case for absolute ligand discrimination : modeling information processing and decision by immune T cells
• Perspectives on theory at the interface of physics and biology
• Signatures of criticality arise in simple neural population models with correlations
• Immune networks: multi-tasking capabilities near saturation
• On the sufficiency of pairwise interactions in maximum entropy models of biological networks
• Statistical Criticality arises in Most Informative Representations
• Searching for simplicity: Approaches to the analysis of neurons and behavior
• The Rank-Size Scaling Law and Entropy-Maximizing Principle
• Latent dynamical variables produce signatures of spatiotemporal criticality in large biological systems
• Mutual information disentangles interactions from changing environments
• Hierarchy and extremes in selections from pools of randomized proteins
• Testing the critical brain hypothesis using a phenomelogical renormalization group
• Beyond position weight matrices: nucleotide correlations in transcription factor binding sites and their description
• Short-range interaction vs long-range correlation in bird flocks
• Maximum entropy distributions on graphs
• Approximate Inference for Time-varying Interactions and Macroscopic Dynamics of Neural Populations
• Separating intrinsic interactions from extrinsic correlations in a network of sensory neurons
• Statistical mechanics of transcription-factor binding site discovery using Hidden Markov Models
• Mean field bipartite spin models treated with mechanical techniques
• Rényi entropy, abundance distribution and the equivalence of ensembles
• Dynamics and Processing in Finite Self-Similar Networks
• Quantifying Relevance in Learning and Inference
• Parallel processing in immune networks
• Correlated fluctuations in strongly-coupled binary networks beyond equilibrium
• Quantifying the entropic cost of cellular growth control
• Inverse spin glass and related maximum entropy problems
• Improving landscape inference by integrating heterogeneous data in the inverse Ising problem
• Random versus maximum entropy models of neural population activity
• Entropy evaluation sheds light on ecosystem complexity
• A general approximation for the dynamics of quantitative traits
• Balancing selfishness and norm conformity can explain human behavior in large-scale Prisoner's Dilemma games and can poise human groups near criticality
• Universality of biochemical feedback and its application to immune cells
• Correlation functions as a tool to study collective behaviour phenomena in biological systems
• Causality inference in stochastic systems from neurons to currencies: Profiting from small sample size
• Stationary properties of maximum entropy random walks
• Emerging heterogeneities in Italian customs and comparison with nearby countries
• Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition
• Complete integrability of information processing by biochemical reactions
• Cooperation, competition and the emergence of criticality in communities of adaptive systems
• Systems poised to criticality through Pareto selective forces
• Organization and evolution of synthetic idiotypic networks
• A generalization of the maximum entropy principle for curved statistical manifolds
• Zipf's law arises naturally in structured, high-dimensional data
• Inferring Cultural Landscapes with the Inverse Ising Model
• Statistical mechanics of the inverse Ising problem and the optimal objective function
• Regularization and decimation pseudolikelihood approaches to statistical inference in $XY$-spin models
• Inferring couplings in networks across order-disorder phase transitions
• When are correlations strong?
• Adaptation to criticality through organizational invariance in embodied agents
• A dynamical model of the adaptive immune system: effects of cells promiscuity, antigens and B-B interactions
• PDE/statistical mechanics duality: relation between Guerra's interpolated $p$-spin ferromagnets and the Burgers hierarchy
• Minimum and maximum entropy distributions for binary systems with known means and pairwise correlations
• From statistical mechanics to information theory: understanding biophysical information-processing systems
• Network inference in the non-equilibrium steady state
• Biases in Inverse Ising Estimates of Near-Critical Behaviour
• Progress and open problems in evolutionary dynamics
• Inference of stochastic time series with missing data
• Message passing algorithms for the Hopfield network reconstruction: threshold behavior and limitation
• The role of idiotypic interactions in the adaptive immune system: a belief-propagation approach
• Counting solutions from finite samplings
• Well posedness and Maximum Entropy Approximation for the Dynamics of Quantitative Traits
• The statistical mechanics of Twitter
• Inverse Ising inference from high-temperature re-weighting of observations
• Semiparametric energy-based probabilistic models
• Extrinsic vs Intrinsic Criticality in Systems with Many Components
• Utilizing entropy to systematically quantify the resting-condition baroreflex regulation function
• Noise equals control
• The role of T-helper/T-suppressor ratio in the adaptive immune response: a dynamical model
• Inferring transition rates on networks with incomplete knowledge
• Universal scaling relation and criticality in metabolism and growth of Escherichia coli
• Complex physical properties of an adaptive, self-organizing biological system
• On a computationally-scalable sparse formulation of the multidimensional and non-stationary maximum entropy principle
• Inferring Local Structure from Pairwise Correlations
• Scaling Monte-Carlo-Based Inference on Antibody and TCR Repertoires
• Hamiltonian Modeling of Macro-Economic Urban Dynamics
• Criticality as It Could Be: organizational invariance as self-organized criticality in embodied agents
• Statistical mechanics of clonal expansion in lymphocyte networks modelled with slow and fast variables
• Affinity maturation for an optimal balance between long-term immune coverage and short-term resource constraints
• Unsupervised Bayesian Ising Approximation for revealing the neural dictionary in songbirds
• Ultrametric identities in glassy models of Natural Evolution
• Coding Sequence Density Estimation Via Topological Pressure
• How heterogeneous thymic output and homeostatic proliferation shape naive T cell receptor clone abundance distributions
• Mutual information in changing environments: non-linear interactions, out-of-equilibrium systems, and continuously-varying diffusivities
• Maximum entropy method: sampling bias
• Anergy in self-directed B lymphocytes from a statistical mechanics perspective
• Capturing coevolutionary signals in repeat proteins
• Italian Twitter semantic network during the Covid-19 epidemic
• Dynamic maximum entropy provides accurate approximation of structured population dynamics
• A Multi-Scale Model for Correlation in B Cell VDJ Usage of Zebrafish
• Convenient Interface to Inverse Ising (ConIII): A Python 3 Package for Solving Ising-Type Maximum Entropy Models