78 citations · 432 across the 28 of their papers we have counts for
12 papers · 1 filter
ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generation
Bang Yang, Fenglin Liu, Yuexian Zou +3
Natural Language Generation (NLG) accepts input data in the form of images, videos, or text and generates corresponding natural language text as output. Existing NLG methods mainly…
Retrieval-Augmented and Knowledge-Grounded Language Models for Faithful Clinical Medicine
Fenglin Liu, Bang Yang, Chenyu You +6
Language models (LMs), including large language models (such as ChatGPT), have the potential to assist clinicians in generating various clinical notes. However, LMs are prone to pr…
Competence-based Multimodal Curriculum Learning for Medical Report Generation
Fenglin Liu, Shen Ge, Yuexian Zou +1
Medical report generation task, which targets to produce long and coherent descriptions of medical images, has attracted growing research interests recently. Different from the gen…
End-to-end Spoken Conversational Question Answering: Task, Dataset and Model
Chenyu You, Nuo Chen, Fenglin Liu +3
In spoken question answering, the systems are designed to answer questions from contiguous text spans within the related speech transcripts. However, the most natural way that huma…
O2NA: An Object-Oriented Non-Autoregressive Approach for Controllable Video Captioning
Fenglin Liu, Xuancheng Ren, Xian Wu +4
Video captioning combines video understanding and language generation. Different from image captioning that describes a static image with details of almost every object, video capt…
Audio-Oriented Multimodal Machine Comprehension: Task, Dataset and Model
Zhiqi Huang, Fenglin Liu, Xian Wu +4
While Machine Comprehension (MC) has attracted extensive research interests in recent years, existing approaches mainly belong to the category of Machine Reading Comprehension task…
Adaptive Bi-directional Attention: Exploring Multi-Granularity Representations for Machine Reading Comprehension
Nuo Chen, Fenglin Liu, Chenyu You +2
Recently, the attention-enhanced multi-layer encoder, such as Transformer, has been extensively studied in Machine Reading Comprehension (MRC). To predict the answer, it is common…
Towards Data Distillation for End-to-end Spoken Conversational Question Answering
Chenyu You, Nuo Chen, Fenglin Liu +2
In spoken question answering, QA systems are designed to answer questions from contiguous text spans within the related speech transcripts. However, the most natural way that human…
PIN: A Novel Parallel Interactive Network for Spoken Language Understanding
Peilin Zhou, Zhiqi Huang, Fenglin Liu +1
Spoken Language Understanding (SLU) is an essential part of the spoken dialogue system, which typically consists of intent detection (ID) and slot filling (SF) tasks. Recently, rec…
Rethinking and Improving Natural Language Generation with Layer-Wise Multi-View Decoding
Fenglin Liu, Xuancheng Ren, Guangxiang Zhao +4
In sequence-to-sequence learning, e.g., natural language generation, the decoder relies on the attention mechanism to efficiently extract information from the encoder. While it is…
Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations
Fenglin Liu, Yuanxin Liu, Xuancheng Ren +2
In vision-and-language grounding problems, fine-grained representations of the image are considered to be of paramount importance. Most of the current systems incorporate visual fe…
simNet: Stepwise Image-Topic Merging Network for Generating Detailed and Comprehensive Image Captions
Fenglin Liu, Xuancheng Ren, Yuanxin Liu +2
The encode-decoder framework has shown recent success in image captioning. Visual attention, which is good at detailedness, and semantic attention, which is good at comprehensivene…