activity
20202023
most citedG-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

88 citations · 212 across the 36 of their papers we have counts for

collaborators
Showing 2021Show all

12 papers · 1 filter

cs.CL2021

Analyzing the Limits of Self-Supervision in Handling Bias in Language

Lisa Bauer, Karthik Gopalakrishnan, Spandana Gella +3

Prompting inputs with natural language task descriptions has emerged as a popular mechanism to elicit reasonably accurate outputs from large-scale generative language models with l…

cs.CL2021

User Response and Sentiment Prediction for Automatic Dialogue Evaluation

Sarik Ghazarian, Behnam Hedayatnia, Alexandros Papangelis +2

Automatic evaluation is beneficial for open-domain dialog system development. However, standard word-overlap metrics (BLEU, ROUGE) do not correlate well with human judgements of op…

cs.CL2021

DirectQuote: A Dataset for Direct Quotation Extraction and Attribution in News Articles

Yuanchi Zhang, Yang Liu

Quotation extraction and attribution are challenging tasks, aiming at determining the spans containing quotations and attributing each quotation to the original speaker. Applying t…

cs.CL2021

Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation

Pei Zhou, Karthik Gopalakrishnan, Behnam Hedayatnia +5

Implicit knowledge, such as common sense, is key to fluid human conversations. Current neural response generation (RG) models are trained to generate responses directly, omitting u…

cs.CL2021★ 2 cited

Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generation

Sashank Santhanam, Behnam Hedayatnia, Spandana Gella +4

Recently neural response generation models have leveraged large pre-trained transformer models and knowledge snippets to generate relevant and informative responses. However, this…

cs.CL2021★ 2 cited

"How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversations

Seokhwan Kim, Yang Liu, Di Jin +4

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the natu…

cs.CL2021★ 1 cited

Commonsense-Focused Dialogues for Response Generation: An Empirical Study

Pei Zhou, Karthik Gopalakrishnan, Behnam Hedayatnia +5

Smooth and effective communication requires the ability to perform latent or explicit commonsense inference. Prior commonsense reasoning benchmarks (such as SocialIQA and Commonsen…

cs.CL2021

Towards Zero and Few-shot Knowledge-seeking Turn Detection in Task-orientated Dialogue Systems

Di Jin, Shuyang Gao, Seokhwan Kim +2

Most prior work on task-oriented dialogue systems is restricted to supporting domain APIs. However, users may have requests that are out of the scope of these APIs. This work focus…

cs.CL2021★ 1 cited

Go Beyond Plain Fine-tuning: Improving Pretrained Models for Social Commonsense

Ting-Yun Chang, Yang Liu, Karthik Gopalakrishnan +3

Pretrained language models have demonstrated outstanding performance in many NLP tasks recently. However, their social intelligence, which requires commonsense reasoning about the…

cs.CL2021

Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Tasks

Ting-Yun Chang, Yang Liu, Karthik Gopalakrishnan +3

Pretrained language models have excelled at many NLP tasks recently; however, their social intelligence is still unsatisfactory. To enable this, machines need to have a more genera…

cs.CV2021★ 1 cited

VISITRON: Visual Semantics-Aligned Interactively Trained Object-Navigator

Ayush Shrivastava, Karthik Gopalakrishnan, Yang Liu +4

Interactive robots navigating photo-realistic environments need to be trained to effectively leverage and handle the dynamic nature of dialogue in addition to the challenges underl…

cs.CL2021★ 9 cited

Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access Track in DSTC9

Seokhwan Kim, Mihail Eric, Behnam Hedayatnia +4

Most prior work on task-oriented dialogue systems are restricted to a limited coverage of domain APIs, while users oftentimes have domain related requests that are not covered by t…