Relevant, hidden, and frustrated information in high-dimensional analyses of complex dynamical systems with internal noise

Abstract

Extracting from trajectory data meaningful information to understand complex molecular systems might be non-trivial. High-dimensional analyses are typically assumed to be desirable, if not required, to prevent losing important information. But to what extent such high-dimensionality is really needed/beneficial often remains unclear. Here we challenge such a fundamental general problem. As a representative case of a system with internal dynamical complexity, we study atomistic molecular dynamics trajectories of liquid water and ice coexisting in dynamical equilibrium at the solid/liquid transition temperature. To attain an intrinsically high-dimensional analysis, we use as an example the Smooth Overlap of Atomic Positions (SOAP) descriptor, obtaining a large dataset containing 2.56e6 576-dimensional SOAP vectors that we analyze in various ways. Our results demonstrate how the time-series data contained in one single SOAP dimension accounting only <0.001% of the total dataset's variance (neglected and discarded in typical variance-based dimensionality-reduction approaches) allows resolving a remarkable amount of information, classifying/discriminating the bulk of water and ice phases, as well as two solid-interface and liquid-interface layers as four statistically distinct dynamical molecular environments. Adding more dimensions to this one is found not only ineffective but even detrimental to the analysis due to recurrent negligible-information/non-negligible-noise additions and "frustrated information" phenomena leading to information loss. Such effects are proven general and are observed also in completely different systems and descriptors' combinations. This shows how high-dimensional analyses are not necessarily better than low-dimensional ones to elucidate the internal complexity of physical/chemical systems, especially when these are characterized by non-negligible internal noise.

References in corpus (22)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• On representing chemical environments
• Scale-free correlations in bird flocks
• Hierarchical group dynamics in pigeon flocks
• Identification of slow molecular order parameters for Markov model construction
• DScribe: Library of Descriptors for Machine Learning in Materials Science
• VAMPnets: Deep learning of molecular kinetics
• Estimating the intrinsic dimension of datasets by a minimal neighborhood information
• How crystals form: A theory of nucleation pathways
• Equilibrium mechanisms of self-limiting assembly
• A mean-field theory for self-propelled particles interacting by velocity alignment mechanisms
• Ice is Born in Low-Mobility Regions of Supercooled Liquid Water
• Updates to the DScribe Library: New Descriptors and Derivatives
• Recursive evaluation and iterative contraction of $N$-body equivariant features
• Detecting dynamic domains and local fluctuations in complex molecular systems via timelapse neighbors shuffling
• Do Machine-Learning Atomic Descriptors and Order Parameters Tell the Same Story? The Case of Liquid Water
• Beyond Local Structures In Critical Supercooled Water Through Unsupervised Learning
• TimeSOAP: Tracking high-dimensional fluctuations in complex molecular systems via time-variations of SOAP spectra
• "Layer-by-layer" Unsupervised Clustering of Statistically Relevant Fluctuations in Noisy Time-series Data of Complex Dynamical Systems
• Change Point Detection of Events in Molecular Simulations using dupin
• Scale adaptive and robust intrinsic dimension estimation via optimal neighbourhood identification
• Unsupervised Tracking of Local and Collective Defects Dynamics in Metals Under Deformation

Cited by in corpus (2)

• A data driven approach to classify descriptors based on their efficiency in translating noisy trajectories into physically-relevant information
• Maximum Information Extraction Via Clustering and Minimization of Shannon Entropy