activity
20152022
most citedMultimodal Intelligence: Representation Learning, Information Fusion, and Applications

500 citations · 1.6k across the 68 of their papers we have counts for

collaborators

72 papers

cs.CV2022★ 2 cited

MNER-QG: An End-to-End MRC framework for Multimodal Named Entity Recognition with Query Grounding

Meihuizi Jia, Lei Shen, Xin Shen +5

Multimodal named entity recognition (MNER) is a critical step in information extraction, which aims to detect entity spans and classify them to corresponding entity types given a s…

cs.SD2022

Multi-Speaker Multi-Style Speech Synthesis with Timbre and Style Disentanglement

Wei Song, Yanghao Yue, Ya-jie Zhang +3

Disentanglement of a speaker's timbre and style is very important for style transfer in multi-speaker multi-style text-to-speech (TTS) scenarios. With the disentanglement of timbre…

cs.CL2022

PLM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training

Junwei Bao, Yifan Wang, Jiangyong Ying +4

Conventional autoregressive left-to-right (L2R) sequence generation faces two issues during decoding: limited to unidirectional target sequence modeling, and constrained on strong…

cs.CL2022★ 2 cited

MuGER: Multi-Granularity Evidence Retrieval and Reasoning for Hybrid Question Answering

Yingyao Wang, Junwei Bao, Chaoqun Duan +3

Hybrid question answering (HQA) aims to answer questions over heterogeneous data, including tables and passages linked to table cells. The heterogeneous data can provide different…

cs.CL2022

UniRPG: Unified Discrete Reasoning over Table and Text as Program Generation

Yongwei Zhou, Junwei Bao, Chaoqun Duan +3

Question answering requiring discrete reasoning, e.g., arithmetic computing, comparison, and counting, over knowledge is a challenging task. In this paper, we propose UniRPG, a sem…

cs.CL2022★ 1 cited

LUNA: Learning Slot-Turn Alignment for Dialogue State Tracking

Yifan Wang, Jing Zhao, Junwei Bao +3

Dialogue state tracking (DST) aims to predict the current dialogue state given the dialogue history. Existing methods generally exploit the utterances of all dialogue turns to assi…