activity
20172021
most citedTruly Multi-modal YouTube-8M Video Classification with Video, Audio, and Text

17 citations · 35 across the 7 of their papers we have counts for

collaborators

13 papers

cs.SD2021

Senone-aware Adversarial Multi-task Training for Unsupervised Child to Adult Speech Adaptation

Richeng Duan, Nancy F. Chen

Acoustic modeling for child speech is challenging due to the high acoustic variability caused by physiological differences in the vocal tract. The dearth of publicly available data…

cs.CL20203 cited

An End-to-End Document-Level Neural Discourse Parser Exploiting Multi-Granularity Representations

Ke Shi, Zhengyuan Liu, Nancy F. Chen

Document-level discourse parsing, in accordance with the Rhetorical Structure Theory (RST), remains notoriously challenging. Challenges include the deep structure of document-level…

cs.CV2020

BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialogues

Hung Le, Doyen Sahoo, Nancy F. Chen +1

Video-grounded dialogues are very challenging due to (i) the complexity of videos which contain both spatial and temporal variations, and (ii) the complexity of user utterances whi…

cs.CL2020

UniConv: A Unified Conversational Neural Architecture for Multi-domain Task-oriented Dialogues

Hung Le, Doyen Sahoo, Chenghao Liu +2

Building an end-to-end conversational agent for multi-domain task-oriented dialogues has been an open challenge for two main reasons. First, tracking dialogue states of multiple do…

cs.CL20203 cited

Multimodal Transformer with Pointer Network for the DSTC8 AVSD Challenge

Hung Le, Nancy F. Chen

Audio-Visual Scene-Aware Dialog (AVSD) is an extension from Video Question Answering (QA) whereby the dialogue agent is required to generate natural language responses to address u…

cs.CL2019

Hierarchical Character Embeddings: Learning Phonological and Semantic Representations in Languages of Logographic Origin using Recursive Neural Networks

Minh Nguyen, Gia H. Ngo, Nancy F. Chen

Logographs (Chinese characters) have recursive structures (i.e. hierarchies of sub-units in logographs) that contain phonological and semantic information, as developmental psychol…