93 citations · 124 across the 14 of their papers we have counts for
14 papers
Learning Open-vocabulary Semantic Segmentation Models From Natural Language Supervision
Jilan Xu, Junlin Hou, Yuejie Zhang +4
In this paper, we consider the problem of open-vocabulary semantic segmentation (OVS), which aims to segment objects of arbitrary classes instead of pre-defined, closed-set categor…
Tag2Text: Guiding Vision-Language Model via Image Tagging
Xinyu Huang, Youcai Zhang, Jinyu Ma +6
This paper presents Tag2Text, a vision language pre-training (VLP) framework, which introduces image tagging into vision-language models to guide the learning of visual-linguistic…
Boosting COVID-19 Severity Detection with Infection-aware Contrastive Mixup Classification
Junlin Hou, Jilan Xu, Nan Zhang +3
This paper presents our solution for the 2nd COVID-19 Severity Detection Competition. This task aims to distinguish the Mild, Moderate, Severe, and Critical grades in COVID-19 ches…
Cross-Field Transformer for Diabetic Retinopathy Grading on Two-field Fundus Images
Junlin Hou, Jilan Xu, Fan Xiao +6
Automatic diabetic retinopathy (DR) grading based on fundus photography has been widely explored to benefit the routine screening and early treatment. Existing researches generally…
CMC v2: Towards More Accurate COVID-19 Detection with Discriminative Video Priors
Junlin Hou, Jilan Xu, Nan Zhang +4
This paper presents our solution for the 2nd COVID-19 Competition, occurring in the framework of the AIMIA Workshop at the European Conference on Computer Vision (ECCV 2022). In ou…
Deep-OCTA: Ensemble Deep Learning Approaches for Diabetic Retinopathy Analysis on OCTA Images
Junlin Hou, Fan Xiao, Jilan Xu +3
The ultra-wide optical coherence tomography angiography (OCTA) has become an important imaging modality in diabetic retinopathy (DR) diagnosis. However, there are few researches fo…
IDEA: Increasing Text Diversity via Online Multi-Label Recognition for Vision-Language Pre-training
Xinyu Huang, Youcai Zhang, Ying Cheng +7
Vision-Language Pre-training (VLP) with large-scale image-text pairs has demonstrated superior performance in various fields. However, the image-text pairs co-occurrent on the Inte…
Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detection
Jiashuo Yu, Jinyu Liu, Ying Cheng +2
Weakly-supervised audio-visual violence detection aims to distinguish snippets containing multimodal violence events with video-level labels. Many prior works perform audio-visual…
FDVTS's Solution for 2nd COV19D Competition on COVID-19 Detection and Severity Analysis
Junlin Hou, Jilan Xu, Rui Feng +1
This paper presents our solution for the 2nd COVID-19 Competition, occurring in the framework of the AIMIA Workshop in the European Conference on Computer Vision (ECCV 2022). In ou…
CREAM: Weakly Supervised Object Localization via Class RE-Activation Mapping
Jilan Xu, Junlin Hou, Yuejie Zhang +5
Weakly Supervised Object Localization (WSOL) aims to localize objects with image-level supervision. Existing works mainly rely on Class Activation Mapping (CAM) derived from a clas…
Self-Supervised Video Representation Learning with Motion-Contrastive Perception
Jinyu Liu, Ying Cheng, Yuejie Zhang +2
Visual-only self-supervised learning has achieved significant improvement in video representation learning. Existing related methods encourage models to learn video representations…
MM-Pyramid: Multimodal Pyramid Attentional Network for Audio-Visual Event Localization and Video Parsing
Jiashuo Yu, Ying Cheng, Rui-Wei Zhao +2
Recognizing and localizing events in videos is a fundamental task for video understanding. Since events may occur in auditory and visual modalities, multimodal detailed perception…
MPN: Multimodal Parallel Network for Audio-Visual Event Localization
Jiashuo Yu, Ying Cheng, Rui Feng
Audio-visual event localization aims to localize an event that is both audible and visible in the wild, which is a widespread audio-visual scene analysis task for unconstrained vid…
Look, Listen, and Attend: Co-Attention Network for Self-Supervised Audio-Visual Representation Learning
Ying Cheng, Ruize Wang, Zhihao Pan +2
When watching videos, the occurrence of a visual event is often accompanied by an audio event, e.g., the voice of lip motion, the music of playing instruments. There is an underlyi…