activity
20202022
most citedMultimodal Knowledge Alignment with Reinforcement Learning

18 citations · 50 across the 11 of their papers we have counts for

collaborators

15 papers

cs.CL202218 cited

Multimodal Knowledge Alignment with Reinforcement Learning

Youngjae Yu, Jiwan Chung, Heeseung Yun +8

Large language models readily adapt to novel settings, even without task-specific training data. Can their zero-shot capacity be extended to multimodal inputs? In this work, we pro…

cs.LG20228 cited

Lipschitz-constrained Unsupervised Skill Discovery

Seohong Park, Jongwook Choi, Jaekyeom Kim +2

We study the problem of unsupervised skill discovery, whose goal is to learn a set of diverse and useful skills with no external reward. There have been a number of skill discovery…

cs.LG2021

Continual Learning on Noisy Data Streams via Self-Purified Replay

Chris Dongjoo Kim, Jinseo Jeong, Sangwoo Moon +1

Continually learning in the real world must overcome many challenges, among which noisy labels are a common and inevitable issue. In this work, we present a repla-ybased continual…

cs.CV2021

Pano-AVQA: Grounded Audio-Visual Question Answering on 360 Videos

Heeseung Yun, Youngjae Yu, Wonsuk Yang +2

360 videos convey holistic views for the surroundings of a scene. It provides audio-visual cues beyond pre-determined normal field of views and displays distinctive spatial…

cs.CL2021

Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causes

Hyunwoo Kim, Byeongchang Kim, Gunhee Kim

Empathy is a complex cognitive ability based on the reasoning of others' affective states. In order to better understand others and express stronger empathy in dialogues, we argue…

cs.SI2021

On the Virality of Animated GIFs on Tumblr

Yunseok Jang, Yale Song, Gunhee Kim

Animated GIFs are becoming increasingly popular in online communication. People use them to express emotion, share their interests and enhance (or even replace) short-form texting;…