4 papers
Rebalanced Multimodal Learning with Data-aware Unimodal Sampling
Qingyuan Jiang, Zhouyang Chi, Xiao Ma +3
To address the modality learning degeneration caused by modality imbalance, existing multimodal learning~(MML) approaches primarily attempt to balance the optimization process of e…
Solution for OOD-CV UNICORN Challenge 2024 Object Detection Assistance LLM Counting Ability Improvement
Zhouyang Chi, Qingyuan Jiang, Yang Yang
This report provide a detailed description of the method that we explored and proposed in the ECCV OOD-CV UNICORN Challenge 2024, which focusing on the robustness of responses from…
Multimodal Classification via Modal-Aware Interactive Enhancement
Qing-Yuan Jiang, Zhouyang Chi, Yang Yang
Due to the notorious modality imbalance problem, multimodal learning (MML) leads to the phenomenon of optimization imbalance, thus struggling to achieve satisfactory performance. R…
Second Place Solution of WSDM2023 Toloka Visual Question Answering Challenge
Xiangyu Wu, Zhouyang Chi, Yang Yang +1
In this paper, we present our solution for the WSDM2023 Toloka Visual Question Answering Challenge. Inspired by the application of multimodal pre-trained models to various downstre…