3 papers
cs.DB2026
SCOPE: Cost-Efficient Model Selection for Compound AI Systems under Quality Constraints
Yiqian Huang, Shiqi Zhang, Tianyuan Jin +1
A compound AI system consists of multiple LLM modules, together handling complex and multi-step tasks that exceed the capabilities of a single model. Existing systems often use a s…
cs.CL2025
SteerConf: Steering LLMs for Confidence Elicitation
Ziang Zhou, Tianyuan Jin, Jieming Shi +1
Large Language Models (LLMs) exhibit impressive performance across diverse domains but often suffer from overconfidence, limiting their reliability in critical applications. We pro…
cs.LG2025
Optimal Batched Best Arm Identification
Tianyuan Jin, Yu Yang, Jing Tang +2
We study the batched best arm identification (BBAI) problem, where the learner's goal is to identify the best arm while switching the policy as less as possible. In particular, we…