16 citations · 29 across the 26 of their papers we have counts for
4 papers · 1 filter
Teaching Text-to-Image Models to Communicate in Dialog
Xiaowen Sun, Jiazhan Feng, Yuxuan Wang +3
A picture is worth a thousand words, thus, it is crucial for conversational agents to understand, perceive, and effectively respond with pictures. However, we find that directly em…
MoviePuzzle: Visual Narrative Reasoning through Multimodal Order Learning
Jianghui Wang, Yuxuan Wang, Dongyan Zhao +1
We introduce MoviePuzzle, a novel challenge that targets visual narrative reasoning and holistic movie understanding. Despite the notable progress that has been witnessed in the re…
Shuo Wen Jie Zi: Rethinking Dictionaries and Glyphs for Chinese Language Pre-training
Yuxuan Wang, Jianghui Wang, Dongyan Zhao +1
We introduce CDBERT, a new learning paradigm that enhances the semantics understanding ability of the Chinese PLMs with dictionary knowledge and structure of Chinese characters. We…
VSTAR: A Video-grounded Dialogue Dataset for Situated Semantic Understanding with Scene and Topic Transitions
Yuxuan Wang, Zilong Zheng, Xueliang Zhao +3
Video-grounded dialogue understanding is a challenging problem that requires machine to perceive, parse and reason over situated semantics extracted from weakly aligned video and d…