activity
20162023
most citedLook, Listen, and Attend: Co-Attention Network for Self-Supervised Audio-Visual Representation Learning

93 citations · 124 across the 15 of their papers we have counts for

collaborators

15 papers

cs.CV2023★ 1 cited

Learning Open-vocabulary Semantic Segmentation Models From Natural Language Supervision

Jilan Xu, Junlin Hou, Yuejie Zhang +4

In this paper, we consider the problem of open-vocabulary semantic segmentation (OVS), which aims to segment objects of arbitrary classes instead of pre-defined, closed-set categor…

cs.CV2023★ 11 cited

Tag2Text: Guiding Vision-Language Model via Image Tagging

Xinyu Huang, Youcai Zhang, Jinyu Ma +6

This paper presents Tag2Text, a vision language pre-training (VLP) framework, which introduces image tagging into vision-language models to guide the learning of visual-linguistic…

eess.IV2022

Boosting COVID-19 Severity Detection with Infection-aware Contrastive Mixup Classification

Junlin Hou, Jilan Xu, Nan Zhang +3

This paper presents our solution for the 2nd COVID-19 Severity Detection Competition. This task aims to distinguish the Mild, Moderate, Severe, and Critical grades in COVID-19 ches…

cs.CV2022★ 2 cited

Cross-Field Transformer for Diabetic Retinopathy Grading on Two-field Fundus Images

Junlin Hou, Jilan Xu, Fan Xiao +6

Automatic diabetic retinopathy (DR) grading based on fundus photography has been widely explored to benefit the routine screening and early treatment. Existing researches generally…

eess.IV2022

CMC v2: Towards More Accurate COVID-19 Detection with Discriminative Video Priors

Junlin Hou, Jilan Xu, Nan Zhang +4

This paper presents our solution for the 2nd COVID-19 Competition, occurring in the framework of the AIMIA Workshop at the European Conference on Computer Vision (ECCV 2022). In ou…

cs.CV2022★ 1 cited

Graph Classification via Discriminative Edge Feature Learning

Yang Yi, Xuequan Lu, Shang Gao +2

Spectral graph convolutional neural networks (GCNNs) have been producing encouraging results in graph classification tasks. However, most spectral GCNNs utilize fixed graphs when a…

eess.IV2022★ 2 cited

Deep-OCTA: Ensemble Deep Learning Approaches for Diabetic Retinopathy Analysis on OCTA Images

Junlin Hou, Fan Xiao, Jilan Xu +3

The ultra-wide optical coherence tomography angiography (OCTA) has become an important imaging modality in diabetic retinopathy (DR) diagnosis. However, there are few researches fo…

cs.CV2022★ 7 cited

IDEA: Increasing Text Diversity via Online Multi-Label Recognition for Vision-Language Pre-training

Xinyu Huang, Youcai Zhang, Ying Cheng +7

Vision-Language Pre-training (VLP) with large-scale image-text pairs has demonstrated superior performance in various fields. However, the image-text pairs co-occurrent on the Inte…

cs.CV2022★ 1 cited

Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detection

Jiashuo Yu, Jinyu Liu, Ying Cheng +2

Weakly-supervised audio-visual violence detection aims to distinguish snippets containing multimodal violence events with video-level labels. Many prior works perform audio-visual…

eess.IV2022★ 4 cited

FDVTS's Solution for 2nd COV19D Competition on COVID-19 Detection and Severity Analysis

Junlin Hou, Jilan Xu, Rui Feng +1

This paper presents our solution for the 2nd COVID-19 Competition, occurring in the framework of the AIMIA Workshop in the European Conference on Computer Vision (ECCV 2022). In ou…

cs.CV2022★ 2 cited

CREAM: Weakly Supervised Object Localization via Class RE-Activation Mapping

Jilan Xu, Junlin Hou, Yuejie Zhang +5

Weakly Supervised Object Localization (WSOL) aims to localize objects with image-level supervision. Existing works mainly rely on Class Activation Mapping (CAM) derived from a clas…

cs.CV2022

Self-Supervised Video Representation Learning with Motion-Contrastive Perception

Jinyu Liu, Ying Cheng, Yuejie Zhang +2

Visual-only self-supervised learning has achieved significant improvement in video representation learning. Existing related methods encourage models to learn video representations…

cs.CV2021

MM-Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing

Jiashuo Yu, Ying Cheng, Rui-Wei Zhao +2

Recognizing and localizing events in videos is a fundamental task for video understanding. Since events may occur in auditory and visual modalities, multimodal detailed perception…

cs.MM2020★ 93 cited

Look, Listen, and Attend: Co-Attention Network for Self-Supervised Audio-Visual Representation Learning

Ying Cheng, Ruize Wang, Zhihao Pan +2

When watching videos, the occurrence of a visual event is often accompanied by an audio event, e.g., the voice of lip motion, the music of playing instruments. There is an underlyi…

cs.CV2016

Salient Object Detection with Convex Hull Overlap

Yongqing Liang

Salient object detection plays an important part in a vision system to detect important regions. Convolutional neural network (CNN) based methods directly train their models with l…