5 citations · 8 across the 8 of their papers we have counts for
3 papers · 1 filter
Position: Understanding LLMs Requires More Than Statistical Generalization
Patrik Reizinger, Szilvia Ujváry, Anna Mészáros +3
The last decade has seen blossoming research in deep learning theory attempting to answer, "Why does deep learning generalize?" A powerful shift in perspective precipitated this pr…
Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learning
Patrik Reizinger, Siyuan Guo, Ferenc Huszár +2
Identifying latent representations or causal structures is important for good generalization and downstream task performance. However, both fields have been developed rather indepe…
Rethinking Sharpness-Aware Minimization as Variational Inference
Szilvia Ujváry, Zsigmond Telek, Anna Kerekes +2
Sharpness-aware minimization (SAM) aims to improve the generalisation of gradient-based learning by seeking out flat minima. In this work, we establish connections between SAM and…