Showing cs.CLShow all
3 papers · 1 filter
cs.CL2026
JudgmentBench: Comparing Rubric and Preference Evaluation for Quality Assessment
Russell Yang, Ruishi Chen, Pierce Kelaita +6
Two methodologies dominate current practices of benchmarking: rubric-based scoring evaluates items against predefined criteria, whereas comparative judgment elicits pairwise prefer…
cs.CL2025
Identifying Emerging Concepts in Large Corpora
Sibo Ma, Julian Nyarko
We introduce a new method to identify emerging concepts in large text corpora. By analyzing changes in the heatmaps of the underlying embedding space, we are able to detect these c…
cs.CL2025
Breaking Down Bias: On The Limits of Generalizable Pruning Strategies
Sibo Ma, Alejandro Salinas, Peter Henderson +1
We employ model pruning to examine how LLMs conceptualize racial biases, and whether a generalizable mitigation strategy for such biases appears feasible. Our analysis yields sever…