1.7k citations · 3k across the 42 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022★ 2 cited
The KITMUS Test: Evaluating Knowledge Integration from Multiple Sources in Natural Language Understanding Systems
Akshatha Arodi, Martin Pömsl, Kaheer Suleman +3
Many state-of-the-art natural language understanding (NLU) models are based on pretrained neural language models. These models often make inferences using information from multiple…
cs.CL2022★ 1 cited
Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications
Kaitlyn Zhou, Su Lin Blodgett, Adam Trischler +3
There are many ways to express similar things in text, which makes evaluating natural language generation (NLG) systems difficult. Compounding this difficulty is the need to assess…