PEER: A Collaborative Language Model

Abstract

Textual content is often the output of a collaborative writing process: We start with an initial draft, ask for suggestions, and repeatedly make changes. Agnostic of this process, today's language models are trained to generate only the final result. As a consequence, they lack several abilities crucial for collaborative writing: They are unable to update existing texts, difficult to control and incapable of verbally planning or explaining their actions. To address these shortcomings, we introduce PEER, a collaborative language model that is trained to imitate the entire writing process itself: PEER can write drafts, add suggestions, propose edits and provide explanations for its actions. Crucially, we train multiple instances of PEER able to infill various parts of the writing process, enabling the use of self-training techniques for increasing the quality, amount and diversity of training data. This unlocks PEER's full potential by making it applicable in domains for which no edit histories are available and improving its ability to follow instructions, to write useful comments, and to explain its actions. We show that PEER achieves strong performance across various domains and editing tasks.

Cited by in corpus (6)

• Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting
• Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate
• CatAlyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Models
• Quantum Natural Language Processing
• Complex QA and language models hybrid architectures, Survey
• Flows: Building Blocks of Reasoning and Collaborating AI