Gauge theory and twins paradox of disentangled representations
arXiv:1906.10545
Abstract
Achieving disentangled representations of information is one of the key goals of deep network based machine learning system. Recently there are more discussions on this issue. In this paper, by comparing the geometric structure of disentangled representation and the geometry of the evolution of mixed states in quantum mechanics, we give a fibre bundle based geometric picture of disentangled representation which can be regarded as a kind of gauge theory. From this perspective we can build a connection between the disentangled representations and the twins paradox in relativity. This can help to clarify some problems about disentangled representation.
arXiv comment5 pages, 2 figures, draft version
References in corpus (6)
- Towards a Definition of Disentangled Representations
- Geometric formulation of quantum mechanics
- Dynamic Distance Measures on Spaces of Isospectral Mixed Quantum States
- How deep learning works --The geometry of deep learning
- Geometrization of deep networks for the interpretability of deep learning systems
- Understanding over-parameterized deep networks by geometrization