6 papers · 1 filter
Meta-Learned Modality-Weighted Knowledge Distillation for Robust Multi-Modal Learning with Missing Data
Hu Wang, Salma Hassan, Yuyuan Liu +12
In multi-modal learning, some modalities are more influential than others, and their absence can have a significant impact on classification/segmentation accuracy. Addressing this…
ItTakesTwo: Leveraging Peer Representations for Semi-supervised LiDAR Semantic Segmentation
Yuyuan Liu, Yuanhong Chen, Hu Wang +3
The costly and time-consuming annotation process to produce large training sets for modelling semantic LiDAR segmentation methods has motivated the development of semi-supervised l…
Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality
Hu Wang, Congbo Ma, Jianpeng Zhang +4
The problem of missing modalities is both critical and non-trivial to be handled in multi-modal models. It is common for multi-modal tasks that certain modalities contribute more c…
Human-AI Collaborative Multi-modal Multi-rater Learning for Endometriosis Diagnosis
Hu Wang, David Butler, Yuan Zhang +5
Endometriosis, affecting about 10% of individuals assigned female at birth, is challenging to diagnose and manage. Diagnosis typically involves the identification of various signs…
CPM: Class-conditional Prompting Machine for Audio-visual Segmentation
Yuanhong Chen, Chong Wang, Yuyuan Liu +2
Audio-visual segmentation (AVS) is an emerging task that aims to accurately segment sounding objects based on audio-visual cues. The success of AVS learning systems depends on the…
A Novel Perspective for Multi-modal Multi-label Skin Lesion Classification
Yuan Zhang, Yutong Xie, Hu Wang +3
The efficacy of deep learning-based Computer-Aided Diagnosis (CAD) methods for skin diseases relies on analyzing multiple data modalities (i.e., clinical+dermoscopic images, and pa…