activity
20182024
most citedmPLUG-Owl: Modularization Empowers Large Language Models with Multimodality

168 citations · 536 across the 43 of their papers we have counts for

collaborators
Showing 2022Show all

9 papers · 1 filter

cs.CV2022★ 10 cited

HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training

Qinghao Ye, Guohai Xu, Ming Yan +4

Video-language pre-training has advanced the performance of various downstream video-language tasks. However, most previous methods directly inherit or adapt typical image-language…

cs.CV2022★ 5 cited

Zero-shot Image Captioning by Anchor-augmented Vision-Language Space Alignment

Junyang Wang, Yi Zhang, Ming Yan +2

CLIP (Contrastive Language-Image Pre-Training) has shown remarkable zero-shot transfer capabilities in cross-modal correlation tasks such as visual classification and image retriev…

cs.CL2022★ 1 cited

Generating Persuasive Responses to Customer Reviews with Multi-Source Prior Knowledge in E-commerce

Bo Chen, Jiayi Liu, Mieradilijiang Maimaiti +2

Customer reviews usually contain much information about one's online shopping experience. While positive reviews are beneficial to the stores, negative ones will largely influence…

cs.CL2022★ 7 cited

DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning

Qianglong Chen, Feng-Lin Li, Guohai Xu +3

Although pre-trained language models (PLMs) have achieved state-of-the-art performance on various natural language processing (NLP) tasks, they are shown to be lacking in knowledge…

cs.CV2022★ 16 cited

X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval

Yiwei Ma, Guohai Xu, Xiaoshuai Sun +3

Video-text retrieval has been a crucial and fundamental task in multi-modal research. The development of video-text retrieval has been considerably promoted by large-scale multi-mo…

cs.CL2022★ 15 cited

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections

Chenliang Li, Haiyang Xu, Junfeng Tian +12

Large-scale pretrained foundation models have been an emerging paradigm for building artificial intelligence (AI) systems, which can be quickly adapted to a wide range of downstrea…

cs.CL2022

MGIMN: Multi-Grained Interactive Matching Network for Few-shot Text Classification

Jianhai Zhang, Mieradilijiang Maimaiti, Xing Gao +2

Text classification struggles to generalize to unseen classes with very few labeled text instances per class. In such a few-shot learning (FSL) setting, metric-based meta-learning…

cs.CL2022★ 1 cited

Auto-MLM: Improved Contrastive Learning for Self-supervised Multi-lingual Knowledge Retrieval

Wenshen Xu, Mieradilijiang Maimaiti, Yuanhang Zheng +2

Contrastive learning (CL) has become a ubiquitous approach for several natural language processing (NLP) downstream tasks, especially for question answering (QA). However, the majo…

cs.CV2022★ 7 cited

Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual Grounding

Jiabo Ye, Junfeng Tian, Ming Yan +5

Visual grounding focuses on establishing fine-grained alignment between vision and natural language, which has essential applications in multimodal reasoning systems. Existing meth…