11 papers · 1 filter
DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images
Pengfei Wang, Shihao Wang, Liyi Chen +3
While monocular depth estimation has achieved significant progress, achieving generalized metric depth estimation for both narrow field-of-view (FoV) perspectives and p…
Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass
Chen Liyi, Wang Pengfei, Zhang Guowen +2
Most instruction-driven 3D editing methods rely on 2D models to guide the explicit and iterative optimization of 3D representations. This paradigm, however, suffers from two primar…
One2Scene: Geometric Consistent Explorable 3D Scene Generation from a Single Image
Pengfei Wang, Liyi Chen, Zhiyuan Ma +3
Generating explorable 3D scenes from a single image is a highly challenging problem in 3D vision. Existing methods struggle to support free exploration, often producing severe geom…
CoCoEdit: Content-Consistent Image Editing via Region Regularized Reinforcement Learning
Yuhui Wu, Chenxi Xie, Ruibin Li +3
Image editing has achieved impressive results with the development of large-scale generative models. However, existing models mainly focus on the editing effects of intended object…
BEVDilation: LiDAR-Centric Multi-Modal Fusion for 3D Object Detection
Guowen Zhang, Chenhang He, Liyi Chen +1
Integrating LiDAR and camera information in the bird's eye view (BEV) representation has demonstrated its effectiveness in 3D object detection. However, because of the fundamental…
Fast Multi-view Consistent 3D Editing with Video Priors
Liyi Chen, Ruihuang Li, Guowen Zhang +2
Text-driven 3D editing enables user-friendly 3D object or scene editing with text instructions. Due to the lack of multi-view consistency priors, existing methods typically resort…
InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Construction
Yuhui Wu, Liyi Chen, Ruibin Li +3
Instruction-based video editing allows effective and interactive editing of videos using only instructions without extra inputs such as masks or attributes. However, collecting hig…
SimCMF: A Simple Cross-modal Fine-tuning Strategy from Vision Foundation Models to Any Imaging Modality
Chenyang Lei, Liyi Chen, Jun Cen +5
Foundation models like ChatGPT and Sora that are trained on a huge scale of data have made a revolutionary social impact. However, it is extremely challenging for sensors in many d…
SimMAT: Exploring Transferability from Vision Foundation Models to Any Image Modality
Chenyang Lei, Liyi Chen, Jun Cen +6
Foundation models like ChatGPT and Sora that are trained on a huge scale of data have made a revolutionary social impact. However, it is extremely challenging for sensors in many d…
General Geometry-aware Weakly Supervised 3D Object Detection
Guowen Zhang, Junsong Fan, Liyi Chen +3
3D object detection is an indispensable component for scene understanding. However, the annotation of large-scale 3D datasets requires significant human effort. To tackle this prob…
SyncNoise: Geometrically Consistent Noise Prediction for Text-based 3D Scene Editing
Ruihuang Li, Liyi Chen, Zhengqiang Zhang +3
Text-based 2D diffusion models have demonstrated impressive capabilities in image generation and editing. Meanwhile, the 2D diffusion models also exhibit substantial potentials for…