6 papers
PixWorld: Unifying 3D Scene Generation and Reconstruction in Pixel Space
Sensen Gao, Zhaoqing Wang, Qihang Cao +3
3D reconstruction and generation are commonly tackled by separate paradigms: pixel-based regression for reconstruction, and latent diffusion for generation. Recent works attempt to…
OneWorld: Taming Scene Generation with 3D Unified Representation Autoencoder
Sensen Gao, Zhaoqing Wang, Qihang Cao +5
Existing diffusion-based 3D scene generation methods primarily operate in 2D image/video latent spaces, which makes maintaining cross-view appearance and geometric consistency inhe…
Taming Camera-Controlled Video Generation with Verifiable Geometry Reward
Zhaoqing Wang, Xiaobo Xia, Zhuolin Bie +4
Recent advances in video diffusion models have remarkably improved camera-controlled video generation, but most methods rely solely on supervised fine-tuning (SFT), leaving online…
MMGen: Unified Multi-modal Image Generation and Understanding in One Go
Jiepeng Wang, Zhaoqing Wang, Hao Pan +4
A unified diffusion framework for multi-modal generation and understanding has the transformative potential to achieve seamless and controllable image diffusion and other cross-mod…
LaVin-DiT: Large Vision Diffusion Transformer
Zhaoqing Wang, Xiaobo Xia, Runnan Chen +4
This paper presents the Large Vision Diffusion Transformer (LaVin-DiT), a scalable and unified foundation model designed to tackle over 20 computer vision tasks in a generative fra…
TrackGo: A Flexible and Efficient Method for Controllable Video Generation
Haitao Zhou, Chuang Wang, Rui Nie +4
Recent years have seen substantial progress in diffusion-based controllable video generation. However, achieving precise control in complex scenarios, including fine-grained object…