134 citations · 718 across the 111 of their papers we have counts for
29 papers · 1 filter
Generalized Decoding for Pixel, Image, and Language
Xueyan Zou, Zi-Yi Dou, Jianwei Yang +11
We present X-Decoder, a generalized decoding model that can predict pixel-level segmentation and language tokens seamlessly. X-Decodert takes as input two types of queries: (i) gen…
Towards Robust NLG Bias Evaluation with Syntactically-diverse Prompts
Arshiya Aggarwal, Jiao Sun, Nanyun Peng
We present a robust methodology for evaluating biases in natural language generation(NLG) systems. Previous works use fixed hand-crafted prefix templates with mentions of various d…
DOC: Improving Long Story Coherence With Detailed Outline Control
Kevin Yang, Dan Klein, Nanyun Peng +1
We propose the Detailed Outline Control (DOC) framework for improving long-range plot coherence when automatically generating several-thousand-word-long stories. DOC consists of tw…
A Moral- and Event- Centric Inspection of Gender Bias in Fairy Tales at A Large Scale
Zhixuan Zhou, Jiao Sun, Jiaxin Pei +2
Fairy tales are a common resource for young children to learn a language or understand how a society works. However, gender bias, e.g., stereotypical gender roles, in this literatu…
Context-Situated Pun Generation
Jiao Sun, Anjali Narayan-Chen, Shereen Oraby +5
Previous work on pun generation commonly begins with a given pun word (a pair of homophones for heterographic pun generation and a polyseme for homographic pun generation) and seek…
ExPUNations: Augmenting Puns with Keywords and Explanations
Jiao Sun, Anjali Narayan-Chen, Shereen Oraby +5
The tasks of humor understanding and generation are challenging and subjective even for humans, requiring commonsense and real-world knowledge to master. Puns, in particular, add t…
A Unified Framework for Pun Generation with Humor Principles
Yufei Tian, Divyanshu Sheth, Nanyun Peng
We propose a unified framework to generate both homophonic and homographic puns to resolve the split-up in existing works. Specifically, we incorporate three linguistic attributes…
EnDex: Evaluation of Dialogue Engagingness at Scale
Guangxuan Xu, Ruibo Liu, Fabrice Harel-Canada +2
We propose EnDex, the first human-reaction based model to evaluate dialogue engagingness. EnDex is trained on 80k Reddit-based Engagement Dataset (RED) curated using a novel distan…
Character-Centric Story Visualization via Visual Planning and Token Alignment
Hong Chen, Rujun Han, Te-Lin Wu +2
Story visualization advances the traditional text-to-image generation by enabling multiple image generation based on a complete story. This task requires machines to 1) understand…
Re3: Generating Longer Stories With Recursive Reprompting and Revision
Kevin Yang, Yuandong Tian, Nanyun Peng +1
We consider the problem of automatically generating longer stories of over two thousand words. Compared to prior work on shorter stories, long-range plot coherence and relevance ar…
Controllable Text Generation for Open-Domain Creativity and Fairness
Nanyun Peng
Recent advances in large pre-trained language models have demonstrated strong results in generating natural languages and significantly improved performances for many natural langu…
NECE: Narrative Event Chain Extraction Toolkit
Guangxuan Xu, Paulina Toro Isaza, Moshi Li +7
To understand a narrative, it is essential to comprehend the temporal event flows, especially those associated with main characters; however, this can be challenging with lengthy a…
DICE: Data-Efficient Clinical Event Extraction with Generative Models
Mingyu Derek Ma, Alexander K. Taylor, Wei Wang +1
Event extraction for the clinical domain is an under-explored research area. The lack of training data along with the high volume of domain-specific terminologies with vague entity…
NewsEdits: A News Article Revision Dataset and a Document-Level Reasoning Challenge
Alexander Spangher, Xiang Ren, Jonathan May +1
News article revision histories provide clues to narrative and factual evolution in news articles. To facilitate analysis of this evolution, we present the first publicly available…
FOAM: A Follower-aware Speaker Model For Vision-and-Language Navigation
Zi-Yi Dou, Nanyun Peng
The speaker-follower models have proven to be effective in vision-and-language navigation, where a speaker model is used to synthesize new instructions to augment the training data…
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
Zi-Yi Dou, Aishwarya Kamath, Zhe Gan +9
Vision-language (VL) pre-training has recently received considerable attention. However, most existing end-to-end pre-training approaches either only aim to tackle VL tasks such as…
Sibylvariant Transformations for Robust Text Classification
Fabrice Harel-Canada, Muhammad Ali Gulzar, Nanyun Peng +1
The vast majority of text transformation techniques in NLP are inherently limited in their ability to expand input space coverage due to an implicit constraint to preserve the orig…
Go Back in Time: Generating Flashbacks in Stories with Event Temporal Prompts
Rujun Han, Hong Chen, Yufei Tian +1
Stories or narratives are comprised of a sequence of events. To compose interesting stories, professional writers often leverage a creative writing technique called flashback that…
AmbiPun: Generating Humorous Puns with Ambiguous Context
Anirudh Mittal, Yufei Tian, Nanyun Peng
In this paper, we propose a simple yet effective way to generate pun sentences that does not require any training on existing puns. Our approach is inspired by humor theories that…
Zero-shot Sonnet Generation with Discourse-level Planning and Aesthetics Features
Yufei Tian, Nanyun Peng
Poetry generation, and creative language generation in general, usually suffers from the lack of large training data. In this paper, we present a novel framework to generate sonnet…
Controllable Text Generation with Neurally-Decomposed Oracle
Tao Meng, Sidi Lu, Nanyun Peng +1
We propose a general and efficient framework to control auto-regressive generation models with NeurAlly-Decomposed Oracle (NADO). Given a pre-trained base language model and a sequ…
TAGPRIME: A Unified Framework for Relational Structure Extraction
I-Hung Hsu, Kuan-Hao Huang, Shuning Zhang +4
Many tasks in natural language processing require the extraction of relationship information for a given condition, such as event argument extraction, relation extraction, and task…
Are Akpans Trick or Treat: Unveiling Helpful Biases in Assistant Systems
Jiao Sun, Yu Hou, Jiin Kim +1
Information-seeking AI assistant systems aim to answer users' queries about knowledge in a timely manner. However, both the human-perceived helpfulness of information-seeking assis…
GENEVA: Benchmarking Generalizability for Event Argument Extraction with Hundreds of Event Types and Argument Roles
Tanmay Parekh, I-Hung Hsu, Kuan-Hao Huang +2
Recent works in Event Argument Extraction (EAE) have focused on improving model generalizability to cater to new events and domains. However, standard benchmarking datasets like AC…