activity
20142024
most citedBeyond Bilinear: Generalized Multimodal Factorized High-order Pooling for Visual Question Answering

560 citations · 1.1k across the 56 of their papers we have counts for

collaborators
Showing 2019Show all

9 papers · 1 filter

cs.CL2019

Building Task-Oriented Visual Dialog Systems Through Alternative Optimization Between Dialog Policy and Language Generation

Mingyang Zhou, Josh Arnold, Zhou Yu

Reinforcement learning (RL) is an effective approach to learn an optimal dialog policy for task-oriented visual dialog systems. A common practice is to apply RL on a neural sequenc…

cs.AI2019★ 5 cited

MOSS: End-to-End Dialog System Framework with Modular Supervision

Weixin Liang, Youzhi Tian, Chengcai Chen +1

A major bottleneck in training end-to-end task-oriented dialog system is the lack of data. To utilize limited training data more efficiently, we propose Modular Supervision Network…

cs.CL2019

Dependency Parsing for Spoken Dialog Systems

Sam Davidson, Dian Yu, Zhou Yu

Dependency parsing of conversational input can play an important role in language understanding for dialog systems by identifying the relationships between entities extracted from…

cs.CL2019★ 3 cited

How to Build User Simulators to Train RL-based Dialog Systems

Weiyan Shi, Kun Qian, Xuewei Wang +1

User simulators are essential for training reinforcement learning (RL) based dialog models. The performance of the simulator directly impacts the RL policy. However, building a goo…

cs.CL2019★ 25 cited

MIDAS: A Dialog Act Annotation Scheme for Open Domain Human Machine Spoken Conversations

Dian Yu, Zhou Yu

Dialog act prediction is an essential language comprehension task for both dialog system building and discourse analysis. Previous dialog act schemes, such as SWBD-DAMSL, are desig…

cs.CV2019★ 99 cited

Deep Modular Co-Attention Networks for Visual Question Answering

Zhou Yu, Jun Yu, Yuhao Cui +2

Visual Question Answering (VQA) requires a fine-grained and simultaneous understanding of both the visual content of images and the textual content of questions. Therefore, designi…