activity
20182021
most citedUMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning

1 citations · 1 across the 1 of their papers we have counts for

collaborators

7 papers

cs.CL2021

QACE: Asking Questions to Evaluate an Image Caption

Hwanhee Lee, Thomas Scialom, Seunghyun Yoon +2

In this paper, we propose QACE, a new metric based on Question Answering for Caption Evaluation. QACE generates questions on the evaluated caption and checks its content by asking…

cs.CL20211 cited

UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning

Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt +2

Despite the success of various text generation metrics such as BERTScore, it is still difficult to evaluate the image captions without enough reference captions due to the diversit…

cs.CL2020

KPQA: A Metric for Generative Question Answering Using Keyphrase Weights

Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt +4

In the automatic evaluation of generative question answering (GenQA) systems, it is difficult to assess the correctness of generated answers due to the free-form of the answer. Esp…

cs.CL2020

DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator

Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt +3

Audio Visual Scene-aware Dialog (AVSD) is the task of generating a response for a question with a given scene, video, audio, and the history of previous turns in the dialog. Existi…

cs.LG2019

Attentive Modality Hopping Mechanism for Speech Emotion Recognition

Seunghyun Yoon, Subhadeep Dey, Hwanhee Lee +1

In this work, we explore the impact of visual modality in addition to speech and text for improving the accuracy of the emotion detection system. The traditional approaches tackle…

cs.CL2018

Improving Neural Question Generation using Answer Separation

Yanghoon Kim, Hwanhee Lee, Joongbo Shin +1

Neural question generation (NQG) is the task of generating a question from a given passage with deep neural networks. Previous NQG models suffer from a problem that a significant p…