3 papers
stat.ML2026
Efficient Sequential Evaluation of Large Language Models
Chia-Yu Hsu, Shubhanshu Shekhar
We study the problem of sequentially evaluating a new large language model (LLM) on a fixed question set using historical performance data from prior LLMs. Our goal is to construct…
math.ST2026
Classifier-Based Nonparametric Sequential Hypothesis Testing
Chia-Yu Hsu, Shubhanshu Shekhar
We consider the problem of constructing sequential power-one tests where the null and alternative classes are specified indirectly through historical or offline data. More specific…
cs.IT2025
Tradeoffs among Action Taking Policies Matter in Active Sequential Multi-Hypothesis Testing: the Optimal Error Exponent Region
Chia-Yu Hsu, I-Hsiang Wang
Reliability of sequential hypothesis testing can be greatly improved when the decision maker is given the freedom to adaptively take an action that determines the distribution of t…