59 citations · 446 across the 85 of their papers we have counts for
26 papers · 1 filter
Multimodal Prototype-Enhanced Network for Few-Shot Action Recognition
Xinzhe Ni, Yong Liu, Hao Wen +3
Current methods for few-shot action recognition mainly fall into the metric learning framework following ProtoNet, which demonstrates the importance of prototypes. Although they ac…
GLeaD: Improving GANs with A Generator-Leading Task
Qingyan Bai, Ceyuan Yang, Yinghao Xu +3
Generative adversarial network (GAN) is formulated as a two-player game between a generator (G) and a discriminator (D), where D is asked to differentiate whether an image comes fr…
Modeling Fine-grained Information via Knowledge-aware Hierarchical Graph for Zero-shot Entity Retrieval
Taiqiang Wu, Xingyu Bai, Weigang Guo +3
Zero-shot entity retrieval, aiming to link mentions to candidate entities under the zero-shot setting, is vital for many tasks in Natural Language Processing. Most existing methods…
3D GAN Inversion with Facial Symmetry Prior
Fei Yin, Yong Zhang, Xuan Wang +8
Recently, a surge of high-quality 3D-aware GANs have been proposed, which leverage the generative power of neural rendering. It is natural to associate 3D GANs with GAN inversion m…
Seeing What You Miss: Vision-Language Pre-training with Semantic Completion Learning
Yatai Ji, Rongcheng Tu, Jie Jiang +6
Cross-modal alignment is essential for vision-language pre-training (VLP) models to learn the correct corresponding information across different modalities. For this purpose, inspi…
MCSCSet: A Specialist-annotated Dataset for Medical-domain Chinese Spelling Correction
Wangjie Jiang, Zhihao Ye, Zijing Ou +7
Chinese Spelling Correction (CSC) is gaining increasing attention due to its promise of automatically detecting and correcting spelling errors in Chinese texts. Despite its extensi…
Global Spectral Filter Memory Network for Video Object Segmentation
Yong Liu, Ran Yu, Jiahao Wang +4
This paper studies semi-supervised video object segmentation through boosting intra-frame interaction. Recent memory network-based methods focus on exploiting inter-frame temporal…
Solving Math Word Problems via Cooperative Reasoning induced Language Models
Xinyu Zhu, Junjie Wang, Lin Zhang +4
Large-scale pre-trained language models (PLMs) bring new opportunities to challenging problems, especially those that need high-level intelligence, such as the math word problem (M…
Improving Your Graph Neural Networks: A High-Frequency Booster
Jiaqi Sun, Lin Zhang, Shenglin Zhao +1
Graph neural networks (GNNs) hold the promise of learning efficient representations of graph-structured data, and one of its most important applications is semi-supervised node cla…
MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model
Yatai Ji, Junjie Wang, Yuan Gong +6
Multimodal semantic understanding often has to deal with uncertainty, which means the obtained messages tend to refer to multiple targets. Such uncertainty is problematic for our i…
Towards Real-World Video Deblurring by Exploring Blur Formation Process
Mingdeng Cao, Zhihang Zhong, Yanbo Fan +5
This paper aims at exploring how to synthesize close-to-real blurs that existing video deblurring models trained on them can generalize well to real-world blurry videos. In recent…
Modelling Latent Dynamics of StyleGAN using Neural ODEs
Weihao Xia, Yujiu Yang, Jing-Hao Xue
In this paper, we propose to model the video dynamics by learning the trajectory of independently inverted latent codes from GANs. The entire sequence is seen as discrete-time obse…
Long Short-Term Preference Modeling for Continuous-Time Sequential Recommendation
Huixuan Chi, Hao Xu, Hao Fu +5
Modeling the evolution of user preference is essential in recommender systems. Recently, dynamic graph-based methods have been studied and achieved SOTA for recommendation, majorit…
Learning Quality-aware Dynamic Memory for Video Object Segmentation
Yong Liu, Ran Yu, Fei Yin +4
Recently, several spatial-temporal memory-based methods have verified that storing intermediate frames and their masks as memory are helpful to segment target objects in videos. Ho…
Rethinking Alignment in Video Super-Resolution Transformers
Shuwei Shi, Jinjin Gu, Liangbin Xie +3
The alignment of adjacent frames is considered an essential operation in video super-resolution (VSR). Advanced VSR models, including the latest VSR Transformers, are generally equ…
MORE: A Metric Learning Based Framework for Open-domain Relation Extraction
Yutong Wang, Renze Lou, Kai Zhang +2
Open relation extraction (OpenRE) is the task of extracting relation schemes from open-domain corpora. Most existing OpenRE methods either do not fully benefit from high-quality la…
Ensemble Multi-Relational Graph Neural Networks
Yuling Wang, Hao Xu, Yanhua Yu +4
It is well established that graph neural networks (GNNs) can be interpreted and designed from the perspective of optimization objective. With this clear optimization objective, the…
Learning Adaptive Warping for Real-World Rolling Shutter Correction
Mingdeng Cao, Zhihang Zhong, Jiahao Wang +2
This paper proposes the first real-world rolling shutter (RS) correction dataset, BS-RSC, and a corresponding model to correct the RS frames in a distorted video. Mobile devices in…
EmpHi: Generating Empathetic Responses with Human-like Intents
Mao Yan Chen, Siheng Li, Yujiu Yang
In empathetic conversations, humans express their empathy to others with empathetic intents. However, most existing empathetic conversational methods suffer from a lack of empathet…
Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Network
Shanshan Lao, Yuan Gong, Shuwei Shi +5
Image quality assessment (IQA) algorithm aims to quantify the human perception of image quality. Unfortunately, there is a performance drop when assessing the distortion images gen…
MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment
Sidi Yang, Tianhe Wu, Shuwei Shi +5
No-Reference Image Quality Assessment (NR-IQA) aims to assess the perceptual quality of images in accordance with human subjective perception. Unfortunately, existing NR-IQA method…
VDTR: Video Deblurring with Transformer
Mingdeng Cao, Yanbo Fan, Yong Zhang +2
Video deblurring is still an unsolved problem due to the challenging spatio-temporal modeling process. While existing convolutional neural network-based methods show a limited capa…
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN
Fei Yin, Yong Zhang, Xiaodong Cun +7
One-shot talking face generation aims at synthesizing a high-quality talking face video from an arbitrary portrait image, driven by a video or an audio segment. One challenging qua…
Context Enhanced Short Text Matching using Clickthrough Data
Mao Yan Chen, Haiyun Jiang, Yujiu Yang
The short text matching task employs a model to determine whether two short texts have the same semantic meaning or intent. Existing short text matching models usually rely on the…