7 citations · 17 across the 6 of their papers we have counts for
4 papers · 1 filter
SeekerGym: A Benchmark for Reliable Information Seeking
Remy Kim, Minseung Lee, Shuo Li +1
Despite their substantial successes, AI agents continue to face fundamental challenges in terms of trustworthiness. Consider deep research agents, tasked with searching for informa…
Alignment of large language models with constrained learning
Botong Zhang, Shuo Li, Ignacio Hounie +3
We study the problem of computing an optimal large language model (LLM) policy for the constrained alignment problem, where the goal is to maximize a primary reward objective while…
Conformal Structured Prediction
Botong Zhang, Shuo Li, Osbert Bastani
Conformal prediction has recently emerged as a promising strategy for quantifying the uncertainty of a predictive model; these algorithms modify the model to output sets of labels…
PAC Confidence Predictions for Deep Neural Network Classifiers
Sangdon Park, Shuo Li, Insup Lee +1
A key challenge for deploying deep neural networks (DNNs) in safety critical settings is the need to provide rigorous ways to quantify their uncertainty. In this paper, we propose…