52 citations · 180 across the 17 of their papers we have counts for
3 papers · 1 filter
An Analytical Characterization of Sloppiness in Neural Networks: Insights from Linear Models
Jialin Mao, Itay Griniasty, Yan Sun +3
Recent experiments have shown that training trajectories of multiple deep neural networks with different architectures, optimization algorithms, hyper-parameter settings, and regul…
The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold
Jialin Mao, Itay Griniasty, Han Kheng Teoh +5
We develop information-geometric techniques to analyze the trajectories of the predictions of deep networks during training. By examining the underlying high-dimensional probabilis…
A picture of the space of typical learnable tasks
Rahul Ramesh, Jialin Mao, Itay Griniasty +5
We develop information geometric techniques to understand the representations learned by deep networks when they are trained on different tasks using supervised, meta-, semi-superv…