Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Prompt Sensitivity in Tool-Augmented Model Comparisons
Mateusz Modrzejewski, Tomasz Radzikowski
Language models are compared on question-answering benchmarks that pose each question in one wording, and a reworded question can change which of two models scores higher. We ask w…
cs.CL2026
What Pairwise Evaluation Misses: Reward Scores across Prompts
Mateusz Modrzejewski, Tomasz Radzikowski
Reward models score responses for preference optimization, filtering and ranking, and pooling scores across prompts needs them to be comparable. Yet pairwise evaluation compares tw…