24 citations · 25 across the 5 of their papers we have counts for
3 papers · 1 filter
Context-dependent agent evaluation with orthogonal equilibrium learning
Haorui Ma, Zehua Zang, Jiangmeng Li +3
Many applications require to evaluate agents under contextual information (e.g., a prompt, task, or user group). We study how to perform such context-dependent agent evaluation fro…
Causal methods for LLM development and evaluation
Dennis Frauen, Marie Brockschmidt, Konstantin Hess +10
Large language model (LLM) development is currently driven by large-scale empirical iteration over data mixtures, reward models, routing strategies, and evaluation pipelines. Here,…
Orthogonal Learner for Estimating Heterogeneous Long-Term Treatment Effects
Haorui Ma, Dennis Frauen, Valentyn Melnychuk +1
Estimation of heterogeneous long-term treatment effects (HLTEs) is relevant for personalized decision-making in marketing, economics, and medicine, where short-term observational d…