8 citations · 8 across the 4 of their papers we have counts for
6 papers
Characterizing the Separability Gap in Prior-Data Fitted Networks
Julius Kobialka, Manuel Hülskamp, Thomas Nagler +1
Prior-data fitted networks (PFNs) are transformers pretrained on simulated datasets to approximate Bayesian posterior predictive distributions. Standard PFN theory assumes a separa…
On the Construction and Implications of Low-Loss Valleys in LoRA-based Bayesian Inference
Daniel Dold, Emanuel Sommer, Julius Kobialka +2
While parameter-efficient fine-tuning methods like low-rank adaptation (LoRA) are standard for large language models, principled estimation of epistemic uncertainty remains challen…
Towards E-Value Based Stopping Rules for Bayesian Deep Ensembles
Emanuel Sommer, Rickmer Schulte, Sarah Deubner +2
Bayesian Deep Ensembles (BDEs) represent a powerful approach for uncertainty quantification in deep learning, combining the robustness of Deep Ensembles (DEs) with flexible multi-c…
On the Interplay of Priors and Overparametrization in Bayesian Neural Network Posteriors
Julius Kobialka, Emanuel Sommer, Chris Kolb +3
Bayesian neural network (BNN) posteriors are often considered impractical for inference, as symmetries fragment them, non-identifiabilities inflate dimensionality, and weight-space…
Paths and Ambient Spaces in Neural Loss Landscapes
Daniel Dold, Julius Kobialka, Nicolai Palm +3
Understanding the structure of neural network loss surfaces, particularly the emergence of low-loss tunnels, is critical for advancing neural network theory and practice. In this p…
Interpretable Machine Learning for TabPFN
David Rundel, Julius Kobialka, Constantin von Crailsheim +3
The recently developed Prior-Data Fitted Networks (PFNs) have shown very promising results for applications in low-data regimes. The TabPFN model, a special case of PFNs for tabula…