137 citations · 166 across the 7 of their papers we have counts for
7 papers
IntentQA: Intent Question Answering in Videos by Cognitive Context Reasoning
Jiapeng Li, Ping Wei, Wenjuan Han +2
Video understanding requires intelligent agents to transcend mere recognition of visual facts and comprehend the underlying intents behind human actions (often termed the "dark mat…
UniLM-Nav: A Unified Framework for Zero-Shot Last-Mile Navigation
Zhuofan Zhang, Tianxu Wang, Guoxi Zhang +6
Mobile manipulation requires a robot to navigate to a target object or receptacle and then perform intended manipulation. However, reaching the vicinity of the target does not guar…
Emergent Graphical Conventions in a Visual Communication Game
Shuwen Qiu, Sirui Xie, Lifeng Fan +4
Humans communicate with graphical sketches apart from symbolic languages. Primarily focusing on the latter, recent studies of emergent communication overlook the sketches; they do…
Learning Triadic Belief Dynamics in Nonverbal Communication from Videos
Lifeng Fan, Shuwen Qiu, Zilong Zheng +3
Humans possess a unique social cognition capability; nonverbal communication can convey rich social information among agents. In contrast, such crucial social characteristics are m…
Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs
Tao Yuan, Hangxin Liu, Lifeng Fan +4
Aiming to understand how human (false-)belief--a core socio-cognitive ability--would affect human interactions with robots, this paper proposes to adopt a graphical model to unify…
Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense
Yixin Zhu, Tao Gao, Lifeng Fan +9
Recent progress in deep learning is essentially based on a "big data for small tasks" paradigm, under which massive amounts of data are used to train a classifier for a single narr…
Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning
Lifeng Fan, Wenguan Wang, Siyuan Huang +2
This paper addresses a new problem of understanding human gaze communication in social videos from both atomic-level and event-level, which is significant for studying human social…