activity
20112023
most citedWhat do you learn from context? Probing for sentence structure in contextualized word representations

139 citations · 635 across the 23 of their papers we have counts for

collaborators

28 papers

cs.CL2023

SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluation

Elizabeth Clark, Shruti Rijhwani, Sebastian Gehrmann +7

Reliable automatic evaluation of summarization systems is challenging due to the multifaceted and subjective nature of the task. This is especially the case for languages other tha…

cs.CL2023

Text-Blueprint: An Interactive Platform for Plan-based Conditional Generation

Fantine Huot, Joshua Maynez, Shashi Narayan +6

While conditional generation models can now generate natural language well enough to create fluent text, it is still difficult to control the generation process, leading to irrelev…

cs.CL2022★ 27 cited

Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models

Bernd Bohnet, Vinh Q. Tran, Pat Verga +19

Large language models (LLMs) have shown impressive results while requiring little or no direct supervision. Further, there is mounting evidence that LLMs may have potential in info…

cs.CL2022★ 10 cited

QAmeleon: Multilingual QA with Only 5 Examples

Priyanka Agrawal, Chris Alberti, Fantine Huot +6

The availability of large, high-quality datasets has been one of the main drivers of recent progress in question answering (QA). Such annotated datasets however are difficult and c…

cs.CL2022★ 5 cited

Query Refinement Prompts for Closed-Book Long-Form Question Answering

Reinald Kim Amplayo, Kellie Webster, Michael Collins +2

Large language models (LLMs) have been shown to perform well in answering questions and in producing long-form texts, both in few-shot closed-book settings. While the former can be…

cs.CL2022★ 54 cited

Language Models are Multilingual Chain-of-Thought Reasoners

Freda Shi, Mirac Suzgun, Markus Freitag +9

We evaluate the reasoning abilities of large language models in multilingual settings. We introduce the Multilingual Grade School Math (MGSM) benchmark, by manually translating 250…