4 papers
Attention Quantization for Tabular Foundation Models
Jonas M. Kübler, Benjamin Jäger, Klemens Flöge +2
With the recent rise and adoption of tabular foundation models, optimizing their inference performance becomes an emerging field for efficiency research. While the models are archi…
Advancing Open and Reproducible Relational Learning: RelArena-, TabPFN-Rel and RPI
Adrian Hayler, Klemens Flöge, Alan Arazi +44
This first release of Prior Labs in relational learning shows our continued commitment to open science. We open-source three pieces of software that we expect to accelerate researc…
Stein Variational Newton Neural Network Ensembles
Klemens Flöge, Mohammed Abdul Moeed, Vincent Fortuin
Deep neural network ensembles are powerful tools for uncertainty quantification, which have recently been re-interpreted from a Bayesian perspective. However, current methods inade…
Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models
Emre Onal, Klemens Flöge, Emma Caldwell +2
Fine-tuned Large Language Models (LLMs) often suffer from overconfidence and poor calibration, particularly when fine-tuned on small datasets. To address these challenges, we propo…