2 papers
stat.ML2024
Towards Understanding Epoch-wise Double descent in Two-layer Linear Neural Networks
Amanda Olmin, Fredrik Lindsten
Epoch-wise double descent is the phenomenon where generalisation performance improves beyond the point of overfitting, resulting in a generalisation curve exhibiting two descents u…
stat.ML2024
On the connection between Noise-Contrastive Estimation and Contrastive Divergence
Amanda Olmin, Jakob Lindqvist, Lennart Svensson +1
Noise-contrastive estimation (NCE) is a popular method for estimating unnormalised probabilistic models, such as energy-based models, which are effective for modelling complex data…