activity
20232026
most citedTowards Better Evaluation of Instruction-Following: A Case-Study in Summarization

1 citations · 1 across the 8 of their papers we have counts for

collaborators

8 papers

cs.HC2026

Fabula: Building a Narrative Storytelling Sidekick with the Writers' Community

Piotr Mirowski, Ben Wedin, Reinald Kim Amplayo +14

We design and evaluate Fabula, an interactive app for fiction writers. Fabula uses detailed narrative plans informed by general narratological theory. Stories are structured hierar…

cs.AI2026

A Subgoal-driven Framework for Improving Long-Horizon LLM Agents

Taiyi Wang, Sian Gooding, Florian Hartmann +2

Large language model (LLM)-based agents have emerged as powerful autonomous controllers for digital environments, including mobile interfaces, operating systems, and web browsers.…

cs.CL2025

Interaction Dynamics as a Reward Signal for LLMs

Sian Gooding, Edward Grefenstette

The alignment of Large Language Models (LLMs) for multi-turn conversations typically relies on reward signals derived from the content of the text. This approach, however, overlook…

cs.LG2025

Generative Data Refinement: Just Ask for Better Data

Minqi Jiang, João G. M. Araújo, Will Ellsworth +2

For a fixed parameter size, the capabilities of large models are primarily determined by the quality and quantity of its training data. Consequently, training datasets now grow fas…

cs.CL2025

Writing as a testbed for open ended agents

Sian Gooding, Lucia Lopez-Rivilla, Edward Grefenstette

Open-ended tasks are particularly challenging for LLMs due to the vast solution space, demanding both expansive exploration and adaptable strategies, especially when success lacks…

cs.LG2023

Social Learning: Towards Collaborative Learning with Large Language Models

Amirkeivan Mohtashami, Florian Hartmann, Sian Gooding +3

We introduce the framework of "social learning" in the context of large language models (LLMs), whereby models share knowledge with each other in a privacy-aware manner using natur…

cs.CL2023

The Impact of Preference Agreement in Reinforcement Learning from Human Feedback: A Case Study in Summarization

Sian Gooding, Hassan Mansoor

Reinforcement Learning from Human Feedback (RLHF) can be used to capture complex and nuanced properties of text generation quality. As a result, the task of text summarization has…

cs.CL2023★ 1 cited

Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization

Ondrej Skopek, Rahul Aralikatte, Sian Gooding +1

Despite recent advances, evaluating how well large language models (LLMs) follow user instructions remains an open problem. While evaluation methods of language models have seen a…