10 papers
From Synthetic Priors to Model Behavior: Structural Coverage in Tabular Foundation Models
He Zhao, Ryan Thompson, Daniel M. Steinberg +3
Tabular foundation models (TFMs) are commonly pretrained on large collections of procedurally generated synthetic tasks, yet it remains unclear how well these synthetic pretraining…
Variational Learning of Fractional Posteriors
Kian Ming A. Chai, Edwin V. Bonilla
We introduce a novel one-parameter variational objective that lower bounds the data evidence and enables the estimation of approximate fractional posteriors. We extend this framewo…
Active Flow Matching
Yashvir S. Grewal, Daniel M. Steinberg, Thang D. Bui +2
Discrete diffusion and flow matching models capture complex, non-additive and non-autoregressive structure in high-dimensional objective landscapes through parallel, iterative refi…
Multi-Scale Wavelet Transformers for Operator Learning of Dynamical Systems
Xuesong Wang, Michael Groom, Rafael Oliveira +3
Recent years have seen a surge in data-driven surrogates for dynamical systems that can be orders of magnitude faster than numerical solvers. However, many machine learning-based m…
Causal Preference Elicitation
Edwin V. Bonilla, He Zhao, Daniel M. Steinberg
We propose causal preference elicitation, a Bayesian framework for expert-in-the-loop causal discovery that actively queries local edge relations to concentrate a posterior over di…
Generative Bayesian Optimization: Generative Models as Acquisition Functions
Rafael Oliveira, Daniel M. Steinberg, Edwin V. Bonilla
We present a general strategy for turning generative models into candidate solution samplers for batch Bayesian optimization (BO). The use of generative models for BO enables large…
Amortized Active Generation of Pareto Sets
Daniel M. Steinberg, Asiri Wijesinghe, Rafael Oliveira +3
We introduce active generation of Pareto sets (A-GPS), a new framework for online discrete black-box multi-objective optimization (MOO). A-GPS learns a generative model of the Pare…
Thompson Sampling in Function Spaces via Neural Operators
Rafael Oliveira, Xuesong Wang, Kian Ming A. Chai +1
We propose an extension of Thompson sampling to optimization problems over function spaces where the objective is a known functional of an unknown operator's output. We assume that…
Variational Search Distributions
Daniel M. Steinberg, Rafael Oliveira, Cheng Soon Ong +1
We develop VSD, a method for conditioning a generative model of discrete, combinatorial designs on a rare desired class by efficiently evaluating a black-box (e.g. experiment, simu…
Bayesian Adaptive Calibration and Optimal Design
Rafael Oliveira, Dino Sejdinovic, David Howard +1
The process of calibrating computer models of natural phenomena is essential for applications in the physical sciences, where plenty of domain knowledge can be embedded into simula…