activity
20172022
most citedPre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

519 citations · 1.7k across the 93 of their papers we have counts for

collaborators

181 papers

cs.CL20221 cited

Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer

Zhengbao Jiang, Luyu Gao, Jun Araki +4

Systems for knowledge-intensive tasks such as open-domain question answering (QA) usually consist of two stages: efficient retrieval of relevant documents from a large corpus and d…

cs.CL20223 cited

MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition

David Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder +42

African languages are spoken by over a billion people, but are underrepresented in NLP research and development. The challenges impeding progress include the limited availability o…

cs.CL2022

English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddings

Yau-Shian Wang, Ashley Wu, Graham Neubig

Universal cross-lingual sentence embeddings map semantically similar cross-lingual sentences into a shared embedding space. Aligning cross-lingual sentence embeddings usually requi…

cs.CL20228 cited

DiffusER: Discrete Diffusion via Edit-based Reconstruction

Machel Reid, Vincent J. Hellendoorn, Graham Neubig

In text generation, models that generate text from scratch one token at a time are currently the dominant paradigm. Despite being performant, these models lack the ability to revis…

cs.CL2022

He Said, She Said: Style Transfer for Shifting the Perspective of Dialogues

Amanda Bertsch, Graham Neubig, Matthew R. Gormley

In this work, we define a new style transfer task: perspective shift, which reframes a dialogue from informal first person to a formal third person rephrasing of the text. This tas…

cs.CL20221 cited

Are Representations Built from the Ground Up? An Empirical Examination of Local Composition in Language Models

Emmy Liu, Graham Neubig

Compositionality, the phenomenon where the meaning of a phrase can be derived from its constituent parts, is a hallmark of human language. At the same time, many phrases are non-co…