2 papers
cs.DS2026
Asymptotically Optimal Sequential Testing with Heterogeneous LLMs
Guokai Li, Alys Liang, Mo Liu +4
We study a Bayesian binary sequential hypothesis testing problem with multiple large language models (LLMs). Each LLM has per-query cost , random waiting time with mean…
stat.ME2026
Minimizing Type 2 Errors in an Experiment-Rich Regime via Optimal Resource Allocation
Fenghua Yang, Dae Woong Ham, Stefanus Jasin
Randomized experiments (often known as "A/B tests") are widely used to evaluate product and service innovations. We study how to allocate limited experimentation resources across M…