126 citations · 376 across the 25 of their papers we have counts for
27 papers
DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks
Kaijie Zhu, Jiaao Chen, Jindong Wang +3
Large language models (LLMs) have achieved remarkable performance in various evaluation benchmarks. However, concerns are raised about potential data contamination in their conside…
Rehearsal: Simulating Conflict to Teach Conflict Resolution
Omar Shaikh, Valentino Chai, Michele J. Gelfand +2
Interpersonal conflict is an uncomfortable but unavoidable fact of life. Navigating conflict successfully is a skill -- one that can be learned through deliberate practice -- but f…
Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedback
Shang-Ling Hsu, Raj Sanjay Shah, Prathik Senthil +4
Millions of users come to online peer counseling platforms to seek support. However, studies show that online peer support groups are not always as effective as expected, largely d…
Understanding people's needs in viewing diverse social opinions about controversial topics
Hayeong Song, Zhengyang Qi, John Stasko +1
Social media (i.e., Reddit) users are overloaded with people's opinions when viewing discourses about divisive topics. Traditional user interfaces in such media present those opini…
Werewolf Among Us: A Multimodal Dataset for Modeling Persuasion Behaviors in Social Deduction Games
Bolin Lai, Hongxin Zhang, Miao Liu +6
Persuasion modeling is a key building block for conversational agents. Existing works in this direction are limited to analyzing textual dialogue corpus. We argue that visual signa…
Modeling Motivational Interviewing Strategies On An Online Peer-to-Peer Counseling Platform
Raj Sanjay Shah, Faye Holt, Shirley Anugrah Hayati +4
Millions of people participate in online peer-to-peer support sessions, yet there has been little prior research on systematic psychology-based evaluations of fine-grained peer-cou…
Six Feet Apart: Online Payments During the COVID-19 Pandemic
Omar Shaikh, Cassandra Ung, Diyi Yang +1
Since the COVID-19 pandemic, businesses have faced unprecedented challenges when trying to remain open. Because COVID-19 spreads through aerosolized droplets, businesses were force…
Disfl-QA: A Benchmark Dataset for Understanding Disfluencies in Question Answering
Aditya Gupta, Jiacheng Xu, Shyam Upadhyay +2
Disfluencies is an under-studied topic in NLP, even though it is ubiquitous in human conversation. This is largely due to the lack of datasets containing disfluencies. In this pape…
HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalization
Jiaao Chen, Dinghan Shen, Weizhu Chen +1
Fine-tuning large pre-trained models with task-specific data has achieved great success in NLP. However, it has been demonstrated that the majority of information within the self-a…
Graph Vulnerability and Robustness: A Survey
Scott Freitas, Diyi Yang, Srijan Kumar +2
The study of network robustness is a critical tool in the characterization and sense making of complex interconnected systems such as infrastructure, communication and social netwo…
Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs
Jiaao Chen, Diyi Yang
Abstractive conversation summarization has received much attention recently. However, these generated summaries often suffer from insufficient, redundant, or incorrect content, lar…
Continual Learning for Text Classification with Information Disentanglement Based Regularization
Yufan Huang, Yanzhe Zhang, Jiaao Chen +2
Continual learning has become increasingly important as it enables NLP models to constantly learn and gain knowledge over time. Previous continual learning methods are mainly desig…
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal +53
We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving ecosystem of auto…
Putting Humans in the Natural Language Processing Loop: A Survey
Zijie J. Wang, Dongjin Choi, Shenyu Xu +1
How can we design Natural Language Processing (NLP) systems that learn from human feedback? There is a growing research body of Human-in-the-loop (HITL) NLP frameworks that continu…
RECAST: Enabling User Recourse and Interpretability of Toxicity Detection Models with Interactive Visualization
Austin P Wright, Omar Shaikh, Haekyu Park +5
With the widespread use of toxic language online, platforms are increasingly using automated systems that leverage advances in natural language processing to automatically flag and…
Weakly-Supervised Hierarchical Models for Predicting Persuasive Strategies in Good-faith Textual Requests
Jiaao Chen, Diyi Yang
Modeling persuasive language has the potential to better facilitate our decision-making processes. Despite its importance, computational modeling of persuasion is still in its infa…
Examining the Ordering of Rhetorical Strategies in Persuasive Requests
Omar Shaikh, Jiaao Chen, Jon Saad-Falcon +2
Interpreting how persuasive language influences audiences has implications across many domains like advertising, argumentation, and propaganda. Persuasion relies on more than a mes…
Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization
Kunal Chawla, Diyi Yang
Formality style transfer is the task of converting informal sentences to grammatically-correct formal sentences, which can be used to improve performance of many downstream NLP tas…
Local Additivity Based Data Augmentation for Semi-supervised NER
Jiaao Chen, Zhenghui Wang, Ran Tian +2
Named Entity Recognition (NER) is one of the first stages in deep language understanding yet current NER models heavily rely on human-annotated data. In this work, to alleviate the…
Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue Summarization
Jiaao Chen, Diyi Yang
Text summarization is one of the most challenging and interesting problems in NLP. Although much attention has been paid to summarizing structured text like news reports or encyclo…
Evaluating Graph Vulnerability and Robustness using TIGER
Scott Freitas, Diyi Yang, Srijan Kumar +2
Network robustness plays a crucial role in our understanding of complex interconnected systems such as transportation, communication, and computer networks. While significant resea…
MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification
Jiaao Chen, Zichao Yang, Diyi Yang
This paper presents MixText, a semi-supervised learning method for text classification, which uses our newly designed data augmentation method called TMix. TMix creates a large amo…
Semi-Supervised Models via Data Augmentationfor Classifying Interactive Affective Responses
Jiaao Chen, Yuwei Wu, Diyi Yang
We present semi-supervised models with data augmentation (SMDA), a semi-supervised text classification system to classify interactive affective responses. SMDA utilizes recent tran…
ToTTo: A Controlled Table-To-Text Generation Dataset
Ankur P. Parikh, Xuezhi Wang, Sebastian Gehrmann +4
We present ToTTo, an open-domain English table-to-text dataset with over 120,000 training examples that proposes a controlled generation task: given a Wikipedia table and a set of…