Neural Feature Geometry Evolves as Discrete Ricci Flow

Moritz Hehl, Max von Renesse, Melanie Weber

Deep neural networks learn feature representations via complex geometric transformations of the input data manifold. Despite the models' empirical success across domains, our under…