Epistemic Uncertainty and Observation Noise with the Neural Tangent Kernel

Sergio Calvo-Ordoñez, Konstantina Palla, Kamil Ciosek

Recent work has shown that training wide neural networks with gradient descent is formally equivalent to computing the mean of the posterior distribution in a Gaussian Process (GP)…