5 papers
District Size Matters: How Seats Per District Shapes Proportionality Under STV
Daryl DeFord, Thomas Ratliff, Ellen Veomett
We study the impact of utilizing multimember districts and Single Transferable Vote (STV) as the winner selection method on partisan proportionality. We start with detailed case st…
Single Canonical Prompts Underestimate LLM Safety's Surface-Form Sensitivity
Yongxi Zhou, Junwei Yao, Yuanzhe Liu +4
A benchmark score is a measurement instrument, yet most benchmarks read each item at a single canonical surface form. We ask whether that reading is faithful: when an item's intent…
How Much Can Repeated Running Buy? A Measured Variance Ceiling for LLM Code Evaluation
Yongxi Zhou, Lai Yun Choi, Jiaxi Wen +2
A benchmark score is a measurement whose uncertainty has two sources: an aleatoric component from stochastic decoding and an epistemic component from the finite problem set. Using…
Multi-Sourced Compositional Generalization in Visual Question Answering
Chuanhao Li, Wenbo Ye, Zhen Li +2
Compositional generalization is the ability of generalizing novel compositions from seen primitives, and has received much attention in vision-and-language (V\&L) recently. Due to…
Consistency of Compositional Generalization across Multiple Levels
Chuanhao Li, Zhen Li, Chenchen Jing +4
Compositional generalization is the capability of a model to understand novel compositions composed of seen concepts. There are multiple levels of novel compositions including phra…