2 papers
cs.CL2024
Data Checklist: On Unit-Testing Datasets with Usable Information
Heidi C. Zhang, Shabnam Behzad, Kawin Ethayarajh +1
Model checklists (Ribeiro et al., 2020) have emerged as a useful tool for understanding the behavior of LLMs, analogous to unit-testing in software engineering. However, despite da…
cs.CL2024
MultiMUC: Multilingual Template Filling on MUC-4
William Gantt, Shabnam Behzad, Hannah YoungEun An +4
We introduce MultiMUC, the first multilingual parallel corpus for template filling, comprising translations of the classic MUC-4 template filling benchmark into five languages: Ara…