4 papers
Rebalanced Multimodal Learning with Data-aware Unimodal Sampling
Qingyuan Jiang, Zhouyang Chi, Xiao Ma +3
To address the modality learning degeneration caused by modality imbalance, existing multimodal learning~(MML) approaches primarily attempt to balance the optimization process of e…
Rethinking Multimodal Learning from the Perspective of Mitigating Classification Ability Disproportion
QingYuan Jiang, Longfei Huang, Yang Yang
Multimodal learning (MML) is significantly constrained by modality imbalance, leading to suboptimal performance in practice. While existing approaches primarily focus on balancing…
The Solution for Temporal Action Localisation Task of Perception Test Challenge 2024
Yinan Han, Qingyuan Jiang, Hongming Mei +2
This report presents our method for Temporal Action Localisation (TAL), which focuses on identifying and classifying actions within specific time intervals throughout a video seque…
Solution for OOD-CV UNICORN Challenge 2024 Object Detection Assistance LLM Counting Ability Improvement
Zhouyang Chi, Qingyuan Jiang, Yang Yang
This report provide a detailed description of the method that we explored and proposed in the ECCV OOD-CV UNICORN Challenge 2024, which focusing on the robustness of responses from…