1 citations · 1 across the 6 of their papers we have counts for
6 papers · 1 filter
ASSERT: A Measurement Pipeline for GenAI Audits
Riccardo Fogliato, Abhinav Palia, Xiawei Wang +11
Audits of generative AI (GenAI) systems often summarize behavior as a reported rate: how often the audited system complies with policy. Researchers and stakeholders use that rate t…
Evaluating the Utility of Grounding Documents with Reference-Free LLM-based Metrics
Yilun Hua, Giuseppe Castellucci, Peter Schulam +2
Retrieval Augmented Generation (RAG)'s success depends on the utility the LLM derives from the content used for grounding. Quantifying content utility does not have a definitive sp…
SumREN: Summarizing Reported Speech about Events in News
Revanth Gangi Reddy, Heba Elfardy, Hou Pong Chan +2
A primary objective of news articles is to establish the factual record for an event, frequently achieved by conveying both the details of the specified event (i.e., the 5 Ws; Who,…
PLAtE: A Large-scale Dataset for List Page Web Extraction
Aidan San, Yuan Zhuang, Jan Bakus +6
Recently, neural models have been leveraged to significantly improve the performance of information extraction from semi-structured websites. However, a barrier for continued progr…
Answer Consolidation: Formulation and Benchmarking
Wenxuan Zhou, Qiang Ning, Heba Elfardy +2
Current question answering (QA) systems primarily consider the single-answer scenario, where each question is assumed to be paired with one correct answer. However, in many real-wo…
Hidden Biases in Unreliable News Detection Datasets
Xiang Zhou, Heba Elfardy, Christos Christodoulopoulos +2
Automatic unreliable news detection is a research problem with great potential impact. Recently, several papers have shown promising results on large-scale news datasets with model…