activity
20232026
most citedEstimating the Hallucination Rate of Generative AI

4 citations · 12 across the 9 of their papers we have counts for

collaborators
Showing 2024Show all

5 papers · 1 filter

stat.ML2024

Can Generative AI Solve Your In-Context Learning Problem? A Martingale Perspective

Andrew Jesson, Nicolas Beltran-Velez, David Blei

This work is about estimating when a conditional generative model (CGM) can solve an in-context learning (ICL) problem. An in-context learning (ICL) problem comprises a CGM, a data…

cs.CL2024

Multi-environment Topic Models

Dominic Sobhani, Amir Feder, David Blei

Probabilistic topic models are a powerful tool for extracting latent themes from large text datasets. In many text datasets, we also observe per-document covariates (e.g., source,…

cs.AI2024

Hypothesis Testing the Circuit Hypothesis in LLMs

Claudia Shi, Nicolas Beltran-Velez, Achille Nazaret +5

Large language models (LLMs) demonstrate surprising capabilities, but we do not understand how they are implemented. One hypothesis suggests that these capabilities are primarily e…

cs.LG2024★ 1 cited

Treeffuser: Probabilistic Predictions via Conditional Diffusions with Gradient-Boosted Trees

Nicolas Beltran-Velez, Alessandro Antonio Grande, Achille Nazaret +2

Probabilistic prediction aims to compute predictive distributions rather than single point predictions. These distributions enable practitioners to quantify uncertainty, compute ri…

cs.LG2024★ 4 cited

Estimating the Hallucination Rate of Generative AI

Andrew Jesson, Nicolas Beltran-Velez, Quentin Chu +5

This paper presents a method for estimating the hallucination rate for in-context learning (ICL) with generative AI. In ICL, a conditional generative model (CGM) is prompted with a…