4 papers
Evaluating the Diversity and Quality of LLM Generated Content
Alexander Shypula, Shuo Li, Botong Zhang +3
Recent work suggests that preference-tuning techniques -- such as Reinforcement Learning from Human Feedback (RLHF) methods like PPO and GRPO, as well as alternatives like DPO -- r…
Alignment of large language models with constrained learning
Botong Zhang, Shuo Li, Ignacio Hounie +3
We study the problem of computing an optimal large language model (LLM) policy for the constrained alignment problem, where the goal is to maximize a primary reward objective while…
A Fast, Reliable, and Secure Programming Language for LLM Agents with Code Actions
Stephen Mell, Botong Zhang, David Mell +5
Modern large language models (LLMs) are often deployed as agents, calling external tools adaptively to solve tasks. Rather than directly calling tools, it can be more effective for…
Conformal Structured Prediction
Botong Zhang, Shuo Li, Osbert Bastani
Conformal prediction has recently emerged as a promising strategy for quantifying the uncertainty of a predictive model; these algorithms modify the model to output sets of labels…