activity
20212024
most citedUniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation

9 citations · 25 across the 9 of their papers we have counts for

collaborators

9 papers

cs.CL2024★ 1 cited

Listening to Patients: A Framework of Detecting and Mitigating Patient Misreport for Medical Dialogue Generation

Lang Qin, Yao Zhang, Hongru Liang +2

Medical Dialogue Systems aim to provide automated healthcare support through patient-agent conversations. Previous efforts typically regard patients as ideal users -- one who accur…

cs.CL2023

Well Begun is Half Done: Generator-agnostic Knowledge Pre-Selection for Knowledge-Grounded Dialogue

Lang Qin, Yao Zhang, Hongru Liang +2

Accurate knowledge selection is critical in knowledge-grounded dialogue systems. Towards a closer look at it, we offer a novel perspective to organize existing literature, i.e., kn…

cs.CL2022★ 2 cited

Joint Open Knowledge Base Canonicalization and Linking

Yinan Liu, Wei Shen, Yuanfei Wang +3

Open Information Extraction (OIE) methods extract a large number of OIE triples (noun phrase, relation phrase, noun phrase) from text, which compose large Open Knowledge Bases (OKB…

cs.IR2022★ 9 cited

Interacting with Non-Cooperative User: A New Paradigm for Proactive Dialogue Policy

Wenqiang Lei, Yao Zhang, Feifan Song +5

Proactive dialogue system is able to lead the conversation to a goal topic and has advantaged potential in bargain, persuasion and negotiation. Current corpus-based learning manner…

cs.CL2022

Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine Comprehension

Huibin Zhang, Zhengkun Zhang, Yao Zhang +5

Procedural Multimodal Documents (PMDs) organize textual instructions and corresponding images step by step. Comprehending PMDs and inducing their representations for the downstream…

cs.CL2022★ 2 cited

HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Tasks

Zhengkun Zhang, Wenya Guo, Xiaojun Meng +5

The workflow of pretraining and fine-tuning has emerged as a popular paradigm for solving various NLP and V&L (Vision-and-Language) downstream tasks. With the capacity of pretraine…

eess.AS2021★ 2 cited

Self-Supervised Learning for speech recognition with Intermediate layer supervision

Chengyi Wang, Yu Wu, Sanyuan Chen +4

Recently, pioneer work finds that speech pre-trained models can solve full-stack speech processing tasks, because the model utilizes bottom layers to learn speaker-related informat…

cs.CL2021★ 9 cited

UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation

Zhengkun Zhang, Xiaojun Meng, Yasheng Wang +3

With the rapid increase of multimedia data, a large body of literature has emerged to work on multimodal summarization, the majority of which target at refining salient information…

cs.AI2021

Fact-Tree Reasoning for N-ary Question Answering over Knowledge Graphs

Yao Zhang, Peiyao Li, Hongru Liang +2

In the question answering(QA) task, multi-hop reasoning framework has been extensively studied in recent years to perform more efficient and interpretable answer reasoning on the K…