36 citations · 79 across the 16 of their papers we have counts for
16 papers
Agentic Monte Carlo: Simulating Reinforcement Learning for Black-Box Agents
Dae Yon Hwang, Raunaq Suri, Valentin Villecroze +4
LLM agents operate in two distinct regimes: open-weight agents amenable to reinforcement learning (RL) and black-box agents whose behaviour must be controlled purely at test time.…
Textual Bayes: Quantifying Prompt Uncertainty in LLM-Based Systems
Brendan Leigh Ross, Noël Vouitsis, Atiyeh Ashari Ghomi +8
Although large language models (LLMs) are becoming increasingly capable of solving challenging real-world tasks, accurately quantifying their uncertainty remains a critical open pr…
Inconsistencies In Consistency Models: Better ODE Solving Does Not Imply Better Samples
Noël Vouitsis, Rasa Hosseinzadeh, Brendan Leigh Ross +4
Although diffusion models can generate remarkably high-quality samples, they are intrinsically bottlenecked by their expensive iterative sampling procedure. Consistency models (CMs…
A Geometric Framework for Understanding Memorization in Generative Models
Brendan Leigh Ross, Hamidreza Kamkari, Tongzi Wu +5
As deep generative models have progressed, recent work has shown them to be capable of memorizing and reproducing training datapoints when deployed. These findings call into questi…
CaloChallenge 2022: A Community Challenge for Fast Calorimeter Simulation
Claudius Krause, Michele Faucci Giannelli, Gregor Kasieczka +66
We present the results of the "Fast Calorimeter Simulation Challenge 2022" - the CaloChallenge. We study state-of-the-art generative models on four calorimeter shower datasets of i…
A Geometric View of Data Complexity: Efficient Local Intrinsic Dimension Estimation with Diffusion Models
Hamidreza Kamkari, Brendan Leigh Ross, Rasa Hosseinzadeh +2
High-dimensional data commonly lies on low-dimensional submanifolds, and estimating the local intrinsic dimension (LID) of a datum -- i.e. the dimension of the submanifold it belon…
Deep Generative Models through the Lens of the Manifold Hypothesis: A Survey and New Connections
Gabriel Loaiza-Ganem, Brendan Leigh Ross, Rasa Hosseinzadeh +2
In recent years there has been increased interest in understanding the interplay between deep generative models (DGMs) and the manifold hypothesis. Research in this area focuses on…
A Geometric Explanation of the Likelihood OOD Detection Paradox
Hamidreza Kamkari, Brendan Leigh Ross, Jesse C. Cresswell +3
Likelihood-based deep generative models (DGMs) commonly exhibit a puzzling behaviour: when trained on a relatively complex dataset, they assign higher likelihood values to out-of-d…
Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models
George Stein, Jesse C. Cresswell, Rasa Hosseinzadeh +7
We systematically study a wide variety of generative models spanning semantically-diverse image datasets to understand and improve the feature extractors and metrics used to evalua…
Denoising Deep Generative Models
Gabriel Loaiza-Ganem, Brendan Leigh Ross, Luhuan Wu +3
Likelihood-based deep generative models have recently been shown to exhibit pathological behaviour under the manifold hypothesis as a consequence of using high-dimensional densitie…
CaloMan: Fast generation of calorimeter showers with density estimation on learned manifolds
Jesse C. Cresswell, Brendan Leigh Ross, Gabriel Loaiza-Ganem +3
Precision measurements and new physics searches at the Large Hadron Collider require efficient simulations of particle propagation and interactions within the detectors. The most c…
Find Your Friends: Personalized Federated Learning with the Right Collaborators
Yi Sui, Junfeng Wen, Yenson Lau +2
In the traditional federated learning setting, a central server coordinates a network of clients to train one global model. However, the global model may serve many clients poorly…
Verifying the Union of Manifolds Hypothesis for Image Data
Bradley C. A. Brown, Anthony L. Caterini, Brendan Leigh Ross +2
Deep learning has had tremendous success at learning low-dimensional representations of high-dimensional data. This success would be impossible if there was no hidden low-dimension…
Neural Implicit Manifold Learning for Topology-Aware Density Estimation
Brendan Leigh Ross, Gabriel Loaiza-Ganem, Anthony L. Caterini +1
Natural data observed in is often constrained to an -dimensional manifold , where . This work focuses on the task of building theoretically pr…
Diagnosing and Fixing Manifold Overfitting in Deep Generative Models
Gabriel Loaiza-Ganem, Brendan Leigh Ross, Jesse C. Cresswell +1
Likelihood-based, or explicit, deep generative models use neural networks to construct flexible high-dimensional densities. This formulation directly contradicts the manifold hypot…
Tractable Density Estimation on Learned Manifolds with Conformal Embedding Flows
Brendan Leigh Ross, Jesse C. Cresswell
Normalizing flows are generative models that provide tractable density estimation via an invertible transformation from a simple base distribution to a complex target distribution.…