activity
20152022
most citedLuna: Linear Unified Nested Attention

49 citations · 80 across the 14 of their papers we have counts for

collaborators
Showing 2021Show all

8 papers · 1 filter

cs.CL2021

Salience-Aware Event Chain Modeling for Narrative Understanding

Xiyang Zhang, Muhao Chen, Jonathan May

Storytelling, whether via fables, news reports, documentaries, or memoirs, can be thought of as the communication of interesting and related events that, taken together, form a con…

cs.CL2021

Viola: A Topic Agnostic Generate-and-Rank Dialogue System

Hyundong Cho, Basel Shbita, Kartik Shenoy +5

We present Viola, an open-domain dialogue system for spoken conversation that uses a topic-agnostic dialogue manager based on a simple generate-and-rank approach. Leveraging recent…

cs.LG202149 cited

Luna: Linear Unified Nested Attention

Xuezhe Ma, Xiang Kong, Sinong Wang +4

The quadratic computational and memory complexities of the Transformer's attention mechanism have limited its scalability for modeling long sequences. In this paper, we propose Lun…

cs.CL20211 cited

X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answering

Meryem M'hamdi, Doo Soon Kim, Franck Dernoncourt +3

Multilingual models, such as M-BERT and XLM-R, have gained increasing popularity, due to their zero-shot cross-lingual transfer learning capabilities. However, their generalization…

cs.CL2021

CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systems

Kushal Chawla, Jaysa Ramirez, Rene Clever +3

Automated systems that negotiate with humans have broad applications in pedagogy and conversational AI. To advance the development of practical negotiation systems, we present CaSi…

cs.CL2021

Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation

Mozhdeh Gheini, Xiang Ren, Jonathan May

We study the power of cross-attention in the Transformer architecture within the context of transfer learning for machine translation, and extend the findings of studies into cross…