20 citations · 35 across the 7 of their papers we have counts for
3 papers · 1 filter
Random matrix theory and the loss surfaces of neural networks
Nicholas P Baskerville
Neural network models are one of the most successful approaches to machine learning, enjoying an enormous amount of development and research over recent years and finding concrete…
Universal characteristics of deep neural network loss surfaces from random matrix theory
Nicholas P Baskerville, Jonathan P Keating, Francesco Mezzadri +2
This paper considers several aspects of random matrix universality in deep neural networks. Motivated by recent experimental work, we use universal properties of random matrices re…
A spin-glass model for the loss surfaces of generative adversarial networks
Nicholas P Baskerville, Jonathan P Keating, Francesco Mezzadri +1
We present a novel mathematical model that seeks to capture the key design feature of generative adversarial networks (GANs). Our model consists of two interacting spin glasses, an…