activity
20182024
most citedThe GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

52 citations · 158 across the 19 of their papers we have counts for

collaborators

21 papers

cs.CL2024

Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in Thai

Parinthapat Pengpun, Can Udomcharoenchaikit, Weerayut Buaphet +1

We present a synthetic data approach for instruction-tuning large language models (LLMs) for low-resource languages in a data-efficient manner, specifically focusing on Thai. We id…

cs.CL2024★ 1 cited

Learning to Plan and Generate Text with Citations

Constanza Fierro, Reinald Kim Amplayo, Fantine Huot +4

The increasing demand for the deployment of LLMs in information-seeking scenarios has spurred efforts in creating verifiable systems, which generate responses to queries along with…

cs.CL2023

Calibrating Likelihoods towards Consistency in Summarization Models

Polina Zablotskaia, Misha Khalman, Rishabh Joshi +4

Despite the recent advances in abstractive text summarization, current summarization models still suffer from generating factually inconsistent summaries, reducing their utility fo…

cs.CL2023

PLAN: Summarizing using a Content Plan as Cross-Lingual Bridge

Fantine Huot, Joshua Maynez, Chris Alberti +5

Cross-lingual summarization consists of generating a summary in one language given an input document in a different language, allowing for the dissemination of relevant content acr…

cs.CL2023

Text-Blueprint: An Interactive Platform for Plan-based Conditional Generation

Fantine Huot, Joshua Maynez, Shashi Narayan +6

While conditional generation models can now generate natural language well enough to create fluent text, it is still difficult to control the generation process, leading to irrelev…

cs.CL2023★ 1 cited

On Uncertainty Calibration and Selective Generation in Probabilistic Neural Summarization: A Benchmark Study

Polina Zablotskaia, Du Phan, Joshua Maynez +3

Modern deep models for summarization attains impressive benchmark performance, but they are prone to generating miscalibrated predictive uncertainty. This means that they assign hi…