The low-rank hypothesis of complex systems

Abstract

Complex systems are high-dimensional nonlinear dynamical systems with intricate interactions among their constituents. To make interpretable predictions about their large-scale behavior, it is typically assumed, without a clear statement, that these dynamics can be reduced to a few number of equations involving a low-rank matrix describing the network of interactions -- what we call the low-rank hypothesis. Our paper sheds light on this assumption and questions its validity. By leveraging fundamental theorems on singular value decomposition, we expose the hypothesis for various random graphs, either by making explicit their low-rank formulation or by demonstrating the exponential decrease of their singular values. Notably, we verify the hypothesis experimentally for real networks by revealing the rapid decrease of their singular values, which has major consequences on their effective ranks. We then evaluate the impact of the low-rank hypothesis for general dynamical systems on networks through an optimal dimension reduction. This allows us to prove that recurrent neural networks can be exactly reduced, and to connect the rapidly decreasing singular values of real networks to the dimension reduction error of the nonlinear dynamics they support, be it microbial, neuronal or epidemiological. Finally, we prove that higher-order interactions naturally emerge from the dimension reduction, thus providing theoretical insights into the origin of higher-order interactions in complex systems.

References in corpus (16)

• Uncovering the overlapping community structure of complex networks in nature and society
• Networks beyond pairwise interactions: structure and dynamics
• The physics of higher-order interactions in complex systems
• The onset of synchronization in large networks of coupled oscillators
• The largest eigenvalue of rank one deformation of large Wigner matrices
• The largest eigenvalues of finite rank deformation of large Wigner matrices: convergence and nonuniversality of the fluctuations
• 20 years of network community detection
• A Universal Route to Explosive Phenomena
• Shaping dynamics with multiple populations in low-rank recurrent networks
• Social confinement and mesoscopic localization of epidemics on networks
• Functional observability and target state estimation in large-scale networks
• Collapse of Resilience Patterns in Generalized Lotka-Volterra Dynamics and Beyond
• Detecting the ultra low dimensionality of real networks
• Accuracy of a one-dimensional reduction of dynamical systems on networks
• Emergent hypernetworks in weakly coupled oscillators
• Threefold way to the dimension reduction of dynamics on networks: an application to synchronization

Cited by in corpus (19)

• Hypergraph reconstruction from dynamics
• Human-like object concept representations emerge naturally in multimodal large language models
• Collective dynamics on higher-order networks
• Dynamical Mean-Field Theory of Complex Systems on Sparse Directed Networks
• Synergistic signatures of group mechanisms in higher-order systems
• Spatiotemporal Implicit Neural Representation as a Generalized Traffic Data Learner
• Upstreamness and downstreamness in input-output analysis from local and aggregate information
• Duality between predictability and reconstructability in complex systems
• Principal component analysis of absorbing state phase transitions
• Explosive neural networks via higher-order interactions in curved statistical manifolds
• Cluster Synchronization via Graph Laplacian Eigenvectors
• Observing network dynamics through sentinel nodes
• From reductionism to realism: Holistic mathematical modelling for complex biological systems
• A projected nonlinear state-space model for forecasting time series signals
• Disorder-promoted stability
• Predicting the Dynamics of Complex System via Multiscale Diffusion Autoencoder
• The cell as a token: high-dimensional geometry in language models and cell embeddings
• Spatio-Temporal Graphical Counterfactuals: An Overview
• Statistics of the non-zero eigenvalues and singular values of low-rank random matrices with non-negative entries