2 papers
cs.CL2026
Controlling Distributional Bias in Multi-Round LLM Generation via KL-Optimized Fine-Tuning
Yanbei Jiang, Amr Keleg, Ryandito Diandaru +4
While the real world is inherently stochastic, Large Language Models (LLMs) are predominantly evaluated on single-round inference against fixed ground truths. In this work, we shif…
cs.CL2024
A Critical Look at Meta-evaluating Summarisation Evaluation Metrics
Xiang Dai, Sarvnaz Karimi, Biaoyan Fang
Effective summarisation evaluation metrics enable researchers and practitioners to compare different summarisation systems efficiently. Estimating the effectiveness of an automatic…