activity
20162024
most citedEvaluation of Text Generation: A Survey

200 citations · 1.3k across the 72 of their papers we have counts for

collaborators
Showing 2021Show all

11 papers · 1 filter

cs.CL2021★ 42 cited

CONFIT: Toward Faithful Dialogue Summarization with Linguistically-Informed Contrastive Fine-tuning

Xiangru Tang, Arjun Nair, Borui Wang +7

Factual inconsistencies in generated summaries severely limit the practical applications of abstractive dialogue summarization. Although significant progress has been achieved by u…

cs.CL2021★ 4 cited

Know Thy Strengths: Comprehensive Dialogue State Tracking Diagnostics

Hyundong Cho, Chinnadhurai Sankar, Christopher Lin +5

Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses…

cs.CL2021★ 4 cited

Discourse-Aware Soft Prompting for Text Generation

Marjan Ghazvininejad, Vladimir Karpukhin, Vera Gor +1

Current efficient fine-tuning methods (e.g., adapters, prefix-tuning, etc.) have optimized conditional text generation via training a small set of extra parameters of the neural la…

cs.CL2021★ 15 cited

Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs

Peter Hase, Mona Diab, Asli Celikyilmaz +5

Do language models have beliefs about the world? Dennett (1995) famously argues that even thermostats have beliefs, on the view that a belief is simply an informational state decou…

cs.CL2021

How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN

R. Thomas McCoy, Paul Smolensky, Tal Linzen +2

Current language models can generate high-quality text. Are they simply copying text they have seen before, or have they learned generalizable linguistic abstractions? To tease apa…

cs.CL2021

An Exploratory Study on Long Dialogue Summarization: What Works and What's Next

Yusen Zhang, Ansong Ni, Tao Yu +6

Dialogue summarization helps readers capture salient information from long conversations in meetings, interviews, and TV series. However, real-world dialogues pose a great challeng…

cs.CL2021★ 1 cited

Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries

Xiangru Tang, Alexander Fabbri, Haoran Li +6

Current pre-trained models applied to summarization are prone to factual inconsistencies which either misrepresent the source text or introduce extraneous information. Thus, compar…

cs.CL2021★ 1 cited

EmailSum: Abstractive Email Thread Summarization

Shiyue Zhang, Asli Celikyilmaz, Jianfeng Gao +1

Recent years have brought about an interest in the challenging task of summarizing conversation threads (meetings, online discussions, etc.). Such summaries help analysis of the lo…

cs.CL2021

Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization

Yichen Jiang, Asli Celikyilmaz, Paul Smolensky +7

Abstractive summarization, the task of generating a concise summary of input documents, requires: (1) reasoning over the source document to determine the salient pieces of informat…

cs.CL2021★ 27 cited

QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization

Ming Zhong, Da Yin, Tao Yu +8

Meetings are a key component of human collaboration. As increasing numbers of meetings are recorded and transcribed, meeting summaries have become essential to remind those who may…

cs.CL2021

Data Augmentation for Abstractive Query-Focused Multi-Document Summarization

Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley +4

The progress in Query-focused Multi-Document Summarization (QMDS) has been limited by the lack of sufficient largescale high-quality training datasets. We present two QMDS training…