Showing 2026Show all
2 papers · 1 filter
cs.CL2026
From Token Probabilities to Semantic Constraints: Towards Declarative Probabilistic Evaluation of Language Models
Kyle Richardson, Cullen Anderson, Pranav Balakrishnan +4
While Large Language Models have improved rapidly, many fundamental questions remain about how to evaluate the knowledge and reasoning abilities they acquire, and how such evaluati…
cs.CL2026
RespondeoQA: a Benchmark for Bilingual Latin-English Question Answering
Marisa Hudspeth, Patrick J. Burns, Brendan O'Connor
We introduce a benchmark dataset for question answering and translation in bilingual Latin and English settings, containing about 7,800 question-answer pairs. The questions are dra…