36 citations · 128 across the 27 of their papers we have counts for
29 papers
TabDPT-Turbo: Efficient In-Context Learning for Tabular Prediction
Rasa Hosseinzadeh, Alex Labach, Zexin Xue +3
Tabular foundation models, driven by in-context learning, have rapidly grown in quality and popularity. However, recent approaches with either cell-based architectures or retrieval…
Understanding the Surprising Generalization Properties of Tabular Foundation Models
Nour Shaheen, Junwei Ma, Alex Labach +3
Tabular Foundation Models (TFMs) increasingly rely on in-context learning, where a model receives labelled examples at inference time and predicts labels for new inputs without upd…
Training Fair Tabular Foundation Models
Patrik Kenfack, Jesse C. Cresswell, Anthony L. Caterini +2
Tabular Foundation Models (TFMs) have emerged as leading methods for tabular predictive tasks, leveraging in-context learning to predict on new data without task-specific training.…
Agentic Monte Carlo: Simulating Reinforcement Learning for Black-Box Agents
Dae Yon Hwang, Raunaq Suri, Valentin Villecroze +4
LLM agents operate in two distinct regimes: open-weight agents amenable to reinforcement learning (RL) and black-box agents whose behaviour must be controlled purely at test time.…
Generalization Can Emerge in Tabular Foundation Models From a Single Table
Junwei Ma, Nour Shaheen, Alex Labach +4
Deep tabular modelling increasingly relies on in-context learning where, during inference, a model receives a set of pairs as context and predicts labels for new inputs wit…
CaloChallenge 2022: A Community Challenge for Fast Calorimeter Simulation
Claudius Krause, Michele Faucci Giannelli, Gregor Kasieczka +66
We present the results of the "Fast Calorimeter Simulation Challenge 2022" - the CaloChallenge. We study state-of-the-art generative models on four calorimeter shower datasets of i…
TabDPT: Scaling Tabular Foundation Models on Real Data
Junwei Ma, Valentin Thomas, Rasa Hosseinzadeh +7
Tabular data is one of the most ubiquitous sources of information worldwide, spanning a wide variety of domains. This inherent heterogeneity has slowed the development of Tabular F…
TabPFGen -- Tabular Data Generation with TabPFN
Junwei Ma, Apoorv Dankar, George Stein +2
Advances in deep generative modelling have not translated well to tabular data. We argue that this is caused by a mismatch in structure between popular generative models and discri…
Retrieval & Fine-Tuning for In-Context Tabular Models
Valentin Thomas, Junwei Ma, Rasa Hosseinzadeh +4
Tabular data is a pervasive modality spanning a wide range of domains, and the inherent diversity poses a considerable challenge for deep learning. Recent advancements using transf…
Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections
Gabriel Loaiza-Ganem, Brendan Leigh Ross, Rasa Hosseinzadeh +2
In recent years there has been increased interest in understanding the interplay between deep generative models (DGMs) and the manifold hypothesis. Research in this area focuses on…
A Geometric Explanation of the Likelihood OOD Detection Paradox
Hamidreza Kamkari, Brendan Leigh Ross, Jesse C. Cresswell +3
Likelihood-based deep generative models (DGMs) commonly exhibit a puzzling behaviour: when trained on a relatively complex dataset, they assign higher likelihood values to out-of-d…
In-Context Data Distillation with TabPFN
Junwei Ma, Valentin Thomas, Guangwei Yu +1
Foundation models have revolutionized tasks in computer vision and natural language processing. However, in the realm of tabular data, tree-based models like XGBoost continue to do…
Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models
George Stein, Jesse C. Cresswell, Rasa Hosseinzadeh +7
We systematically study a wide variety of generative models spanning semantically-diverse image datasets to understand and improve the feature extractors and metrics used to evalua…
Denoising Deep Generative Models
Gabriel Loaiza-Ganem, Brendan Leigh Ross, Luhuan Wu +3
Likelihood-based deep generative models have recently been shown to exhibit pathological behaviour under the manifold hypothesis as a consequence of using high-dimensional densitie…
CaloMan: Fast generation of calorimeter showers with density estimation on learned manifolds
Jesse C. Cresswell, Brendan Leigh Ross, Gabriel Loaiza-Ganem +3
Precision measurements and new physics searches at the Large Hadron Collider require efficient simulations of particle propagation and interactions within the detectors. The most c…
Relating Regularization and Generalization through the Intrinsic Dimension of Activations
Bradley C. A. Brown, Jordan Juravsky, Anthony L. Caterini +1
Given a pair of models with similar training set performance, it is natural to assume that the model that possesses simpler internal representations would exhibit better generaliza…
Verifying the Union of Manifolds Hypothesis for Image Data
Bradley C. A. Brown, Anthony L. Caterini, Brendan Leigh Ross +2
Deep learning has had tremendous success at learning low-dimensional representations of high-dimensional data. This success would be impossible if there was no hidden low-dimension…
Neural Implicit Manifold Learning for Topology-Aware Density Estimation
Brendan Leigh Ross, Gabriel Loaiza-Ganem, Anthony L. Caterini +1
Natural data observed in is often constrained to an -dimensional manifold , where . This work focuses on the task of building theoretically pr…
Diagnosing and Fixing Manifold Overfitting in Deep Generative Models
Gabriel Loaiza-Ganem, Brendan Leigh Ross, Jesse C. Cresswell +1
Likelihood-based, or explicit, deep generative models use neural networks to construct flexible high-dimensional densities. This formulation directly contradicts the manifold hypot…
Entropic Issues in Likelihood-Based OOD Detection
Anthony L. Caterini, Gabriel Loaiza-Ganem
Deep generative models trained by maximum likelihood remain very popular methods for reasoning about data probabilistically. However, it has been observed that they can assign high…
Rectangular Flows for Manifold Learning
Anthony L. Caterini, Gabriel Loaiza-Ganem, Geoff Pleiss +1
Normalizing flows are invertible neural networks with tractable change-of-volume terms, which allow optimization of their parameters to be efficiently performed via maximum likelih…
C-Learning: Horizon-Aware Cumulative Accessibility Estimation
Panteha Naderian, Gabriel Loaiza-Ganem, Harry J. Braviner +4
Multi-goal reaching is an important problem in reinforcement learning needed to achieve algorithmic generalization. Despite recent advances in this field, current algorithms suffer…
Variational Inference with Continuously-Indexed Normalizing Flows
Anthony Caterini, Rob Cornish, Dino Sejdinovic +1
Continuously-indexed flows (CIFs) have recently achieved improvements over baseline normalizing flows on a variety of density estimation tasks. CIFs do not possess a closed-form ma…
Detecting anthropogenic cloud perturbations with deep learning
Duncan Watson-Parris, Samuel Sutherland, Matthew Christensen +3
One of the most pressing questions in climate science is that of the effect of anthropogenic aerosol on the Earth's energy balance. Aerosols provide the `seeds' on which cloud drop…