TMI: Thermodynamic inference of data manifolds
arXiv:1911.09776 · doi:10.1103/PhysRevResearch.2.023201
Abstract
The Gibbs-Boltzmann distribution offers a physically interpretable way to massively reduce the dimensionality of high dimensional probability distributions where the extensive variables are `features' and the intensive variables are `descriptors'. However, not all probability distributions can be modeled using the Gibbs-Boltzmann form. Here, we present TMI: TMI, {\bf T}hermodynamic {\bf M}anifold {\bf I}nference; a thermodynamic approach to approximate a collection of arbitrary distributions. TMI simultaneously learns from data intensive and extensive variables and achieves dimensionality reduction through a multiplicative, positive valued, and interpretable decomposition of the data. Importantly, the reduced dimensional space of intensive parameters is not homogeneous. The Gibbs-Boltzmann distribution defines an analytically tractable Riemannian metric on the space of intensive variables allowing us to calculate geodesics and volume elements. We discuss the applications of TMI with multiple real and artificial data sets. Possible extensions are discussed as well.
References in corpus (4)
- Maximum Caliber: a general variational principle for dynamical systems
- A geometric approach to optimal nonequilibrium control: Minimizing dissipation in nanomagnetic spin systems
- Learning Dynamic Boltzmann Distributions as Reduced Models of Spatial Chemical Kinetics
- Learning Moment Closure in Reaction-Diffusion Systems with Spatial Dynamic Boltzmann Distributions