33 citations · 229 across the 20 of their papers we have counts for
21 papers
On the Challenges and Opportunities in Generative AI
Laura Manduchi, Clara Meister, Kushagra Pandey +23
The field of deep generative modeling has grown rapidly in the last few years. With the availability of massive amounts of training data coupled with advances in scalable unsupervi…
Evaluating the Fairness of Discriminative Foundation Models in Computer Vision
Junaid Ali, Matthaeus Kleindessner, Florian Wenzel +3
We propose a novel taxonomy for bias evaluation of discriminative foundation models, such as Contrastive Language-Pretraining (CLIP), that are used for labeling tasks. We then syst…
Image retrieval outperforms diffusion models on data augmentation
Max F. Burg, Florian Wenzel, Dominik Zietlow +4
Many approaches have been proposed to use diffusion models to augment training datasets for downstream tasks, such as classification. However, diffusion models are themselves train…
Leveraging sparse and shared feature activations for disentangled representation learning
Marco Fumero, Florian Wenzel, Luca Zancato +5
Recovering the latent factors of variation of high dimensional data has so far focused on simple synthetic settings. Mostly building on unsupervised and weakly-supervised objective…
Multi-Symmetry Ensembles: Improving Diversity and Generalization via Opposing Symmetries
Charlotte Loh, Seungwook Han, Shivchander Sudalairaj +5
Deep ensembles (DE) have been successful in improving model performance by learning diverse members via the stochasticity of random initialization. While recent works have attempte…
Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift
Jielin Qiu, Yi Zhu, Xingjian Shi +5
Multimodal image-text models have shown remarkable performance in the past few years. However, evaluating robustness against distribution shifts is crucial before adopting them in…
Assaying Out-Of-Distribution Generalization in Transfer Learning
Florian Wenzel, Andrea Dittadi, Peter Vincent Gehler +9
Since out-of-distribution generalization is a generally ill-posed problem, various proxy targets (e.g., calibration, adversarial robustness, algorithmic corruptions, invariance acr…
Sparse MoEs meet Efficient Ensembles
James Urquhart Allingham, Florian Wenzel, Zelda E Mariet +10
Machine learning models based on the aggregated outputs of submodels, either at the activation or prediction levels, often exhibit strong performance compared to individual models.…
Deep Classifiers with Label Noise Modeling and Distance Awareness
Vincent Fortuin, Mark Collier, Florian Wenzel +7
Uncertainty estimation in deep learning has recently emerged as a crucial area of interest to advance reliability and robustness in safety-critical applications. While there have b…
On Stein Variational Neural Network Ensembles
Francesco D'Angelo, Vincent Fortuin, Florian Wenzel
Ensembles of deep neural networks have achieved great success recently, but they do not offer a proper Bayesian justification. Moreover, while they allow for averaging of predictio…
Uncertainty Baselines: Benchmarks for Uncertainty & Robustness in Deep Learning
Zachary Nado, Neil Band, Mark Collier +23
High-quality estimates of uncertainty and robustness are crucial for numerous real-world applications, especially for deep learning which underlies many deployed ML systems. The ab…
Bayesian Neural Network Priors Revisited
Vincent Fortuin, Adrià Garriga-Alonso, Sebastian W. Ober +5
Isotropic Gaussian priors are the de facto standard for modern Bayesian neural network inference. However, it is unclear whether these priors accurately reflect our true beliefs ab…
Hyperparameter Ensembles for Robustness and Uncertainty Quantification
Florian Wenzel, Jasper Snoek, Dustin Tran +1
Ensembles over neural network weights trained from different random initialization, known as deep ensembles, achieve state-of-the-art accuracy and calibration. The recently introdu…
Automated Augmented Conjugate Inference for Non-conjugate Gaussian Process Models
Théo Galy-Fajou, Florian Wenzel, Manfred Opper
We propose automated augmented conjugate inference, a new inference method for non-conjugate Gaussian processes (GP) models. Our method automatically constructs an auxiliary variab…
How Good is the Bayes Posterior in Deep Neural Networks Really?
Florian Wenzel, Kevin Roth, Bastiaan S. Veeling +7
During the past five years the Bayesian deep learning community has developed increasingly accurate and efficient approximate inference procedures that allow for Bayesian inference…
Multi-Class Gaussian Process Classification Made Conjugate: Efficient Inference via Data Augmentation
Théo Galy-Fajou, Florian Wenzel, Christian Donner +1
We propose a new scalable multi-class Gaussian process classification approach building on a novel modified softmax likelihood function. The new likelihood has two benefits: it lea…
Quasi-Monte Carlo Variational Inference
Alexander Buchholz, Florian Wenzel, Stephan Mandt
Many machine learning problems involve Monte Carlo gradient estimators. As a prominent example, we focus on Monte Carlo variational inference (MCVI) in this paper. The performance…
Scalable Generalized Dynamic Topic Models
Patrick Jähnichen, Florian Wenzel, Marius Kloft +1
Dynamic topic models (DTMs) model the evolution of prevalent themes in literature, online media, and other forms of text over time. DTMs assume that word co-occurrence statistics c…
Efficient Gaussian Process Classification Using Polya-Gamma Data Augmentation
Florian Wenzel, Theo Galy-Fajou, Christan Donner +2
We propose a scalable stochastic variational approach to GP classification building on Polya-Gamma data augmentation and inducing points. Unlike former approaches, we obtain closed…
Bayesian Nonlinear Support Vector Machines for Big Data
Florian Wenzel, Theo Galy-Fajou, Matthaeus Deutsch +1
We propose a fast inference method for Bayesian nonlinear support vector machines that leverages stochastic variational inference and inducing points. Our experiments show that the…
Sparse Probit Linear Mixed Model
Stephan Mandt, Florian Wenzel, Shinichi Nakajima +3
Linear Mixed Models (LMMs) are important tools in statistical genetics. When used for feature selection, they allow to find a sparse set of genetic traits that best predict a conti…