15 citations · 34 across the 8 of their papers we have counts for
10 papers
DreamLLM: Synergistic Multimodal Comprehension and Creation
Runpei Dong, Chunrui Han, Yuang Peng +11
This paper presents DreamLLM, a learning framework that first achieves versatile Multimodal Large Language Models (MLLMs) empowered with frequently overlooked synergy between multi…
ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning
Liang Zhao, En Yu, Zheng Ge +8
Human-AI interactivity is a critical aspect that reflects the usability of multimodal large language models (MLLMs). However, existing end-to-end MLLMs only allow users to interact…
GMM: Delving into Gradient Aware and Model Perceive Depth Mining for Monocular 3D Detection
Weixin Mao, Jinrong Yang, Zheng Ge +5
Depth perception is a crucial component of monoc-ular 3D detection tasks that typically involve ill-posed problems. In light of the success of sample mining techniques in 2D object…
Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perception
Chunrui Han, Jinrong Yang, Jianjian Sun +6
Long-term temporal fusion is a crucial but often overlooked technique in camera-based Bird's-Eye-View (BEV) 3D perception. Existing methods are mostly in a parallel manner. While p…
A Comprehensive Survey on Multimodal Recommender Systems: Taxonomy, Evaluation, and Future Directions
Hongyu Zhou, Xin Zhou, Zhiwei Zeng +2
Recommendation systems have become popular and effective tools to help users discover their interesting items by modeling the user preference and item property based on implicit in…
Enhancing Dyadic Relations with Homogeneous Graphs for Multimodal Recommendation
Hongyu Zhou, Xin Zhou, Lingzi Zhang +1
User interaction data in recommender systems is a form of dyadic relation that reflects the preferences of users with items. Learning the representations of these two discrete sets…
MatrixVT: Efficient Multi-Camera to BEV Transformation for 3D Perception
Hongyu Zhou, Zheng Ge, Zeming Li +1
This paper proposes an efficient multi-camera to Bird's-Eye-View (BEV) view transformation method for 3D perception, dubbed MatrixVT. Existing view transformers either suffer from…
PersDet: Monocular 3D Detection in Perspective Bird's-Eye-View
Hongyu Zhou, Zheng Ge, Weixin Mao +1
Currently, detecting 3D objects in Bird's-Eye-View (BEV) is superior to other 3D detectors for autonomous driving and robotics. However, transforming image features into BEV necess…
Dense Teacher: Dense Pseudo-Labels for Semi-supervised Object Detection
Hongyu Zhou, Zheng Ge, Songtao Liu +4
To date, the most powerful semi-supervised object detectors (SS-OD) are based on pseudo-boxes, which need a sequence of post-processing with fine-tuned hyper-parameters. In this wo…
NTIRE 2020 Challenge on NonHomogeneous Dehazing
Codruta O. Ancuti, Cosmin Ancuti, Florin-Alexandru Vasluianu +49
This paper reviews the NTIRE 2020 Challenge on NonHomogeneous Dehazing of images (restoration of rich details in hazy image). We focus on the proposed solutions and their results e…