19 citations · 69 across the 25 of their papers we have counts for
6 papers · 1 filter
Mitigating Forgetting in Low Rank Adaptation
Joanna Sliwa, Frank Schneider, Philipp Hennig +1
Parameter-efficient fine-tuning methods, such as Low-Rank Adaptation (LoRA), enable fast specialization of large pre-trained models to different downstream applications. However, t…
Training-Free Vector Quantization via Gaussian VAEs
Tongda Xu, Wendi Zheng, Jiajun He +4
Vector-quantized variational autoencoders (VQ-VAEs) are discrete autoencoders that compress images into discrete tokens. However, they are difficult to train due to discretization.…
Weighted Conditional Flow Matching
Sergio Calvo-Ordonez, Matthieu Meunier, Alvaro Cartea +3
Conditional flow matching (CFM) has emerged as a powerful framework for training continuous normalizing flows due to its computational efficiency and effectiveness. However, standa…
A Machine Learning Benchmarking Framework for Lipid Nanoparticle Transfection Efficiency Prediction
Asal Mehradfar, Mohammad Shahab Sepehri, Jose Miguel Hernandez-Lobato +4
The discovery of new ionizable lipids for efficient lipid nanoparticle (LNP)-mediated RNA delivery remains a major bottleneck in RNA therapeutics development. Recent advances demon…
Post-Hoc Uncertainty Quantification in Pre-Trained Neural Networks via Activation-Level Gaussian Processes
Richard Bergna, Stefan Depeweg, Sergio Calvo Ordonez +3
Uncertainty quantification in neural networks through methods such as Dropout, Bayesian neural networks and Laplace approximations is either prone to underfitting or computationall…
A Gaussian Process View on Observation Noise and Initialization in Wide Neural Networks
Sergio Calvo-Ordoñez, Jonathan Plenk, Richard Bergna +4
Performing gradient descent in a wide neural network is equivalent to computing the posterior mean of a Gaussian Process with the Neural Tangent Kernel (NTK-GP), for a specific pri…