33 citations · 104 across the 21 of their papers we have counts for
7 papers · 1 filter
SIMBA UQ: Similarity-Based Aggregation for Uncertainty Quantification in Large Language Models
Debarun Bhattacharjya, Balaji Ganesan, Junkyu Lee +4
When does a large language model (LLM) know what it does not know? Uncertainty quantification (UQ) provides measures of uncertainty, such as an estimate of the confidence in an LLM…
QueryGym: Step-by-Step Interaction with Relational Databases
Haritha Ananthakrishnan, Harsha Kokel, Kelsey Sikes +4
We introduce QueryGym, an interactive environment for building, testing, and evaluating LLM-based query planning agents. Existing frameworks often tie agents to specific query lang…
What Would an LLM Do? Evaluating Large Language Models for Policymaking to Alleviate Homelessness
Pierre Le Coz, Jia An Liu, Debarun Bhattacharjya +2
Large language models (LLMs) are increasingly being adopted in high-stakes domains. Their potential to encode evolving social contexts and to generate plausible scenarios position…
The Consistency Hypothesis in Uncertainty Quantification for Large Language Models
Quan Xiao, Debarun Bhattacharjya, Balaji Ganesan +5
Estimating the confidence of large language model (LLM) outputs is essential for real-world applications requiring high user trust. Black-box uncertainty quantification (UQ) method…
Knowledge Base Construction for Knowledge-Augmented Text-to-SQL
Jinheon Baek, Horst Samulowitz, Oktie Hassanzadeh +4
Text-to-SQL aims to translate natural language queries into SQL statements, which is practical as it enables anyone to easily retrieve the desired information from databases. Recen…
Q-function Decomposition with Intervention Semantics with Factored Action Spaces
Junkyu Lee, Tian Gao, Elliot Nelson +3
Many practical reinforcement learning environments have a discrete factored action space that induces a large combinatorial set of actions, thereby posing significant challenges. E…
FactReasoner: A Probabilistic Approach to Long-Form Factuality Assessment for Large Language Models
Radu Marinescu, Debarun Bhattacharjya, Junkyu Lee +5
Large language models (LLMs) have achieved remarkable success in generative tasks, yet they often fall short in ensuring the factual accuracy of their outputs, thus limiting their…