2 citations · 2 across the 6 of their papers we have counts for
7 papers
Plenoptic Video Generation
Xiao Fu, Shitao Tang, Min Shi +5
Camera-controlled generative video re-rendering methods, such as ReCamMaster, have achieved remarkable progress. However, despite their success in single-view setting, these works…
Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Control
Xiao Fu, Xintao Wang, Xian Liu +5
Recent advances in video diffusion models shows promise for generating robotic decision-making data, with trajectory conditions further enabling fine-grained control. However, exis…
The Dance of Atoms-De Novo Protein Design with Diffusion Model
Yujie Qin, Ming He, Changyong Yu +3
The de novo design of proteins refers to creating proteins with specific structures and functions that do not naturally exist. In recent years, the accumulation of high-quality pro…
Simulating the Real World: A Unified Survey of Multimodal Generative Models
Yuqi Hu, Longguang Wang, Xian Liu +7
Understanding and replicating the real world is a critical challenge in Artificial General Intelligence (AGI) research. To achieve this, many existing approaches, such as world mod…
3DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generation
Xiao Fu, Xian Liu, Xintao Wang +7
This paper aims to manipulate multi-entity 3D motions in video generation. Previous methods on controllable video generation primarily leverage 2D control signals to manipulate obj…
Object-Compositional Neural Implicit Surfaces
Qianyi Wu, Xian Liu, Yuedong Chen +4
The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on…
Motion Capture from Internet Videos
Junting Dong, Qing Shuai, Yuanqing Zhang +3
Recent advances in image-based human pose estimation make it possible to capture 3D human motion from a single RGB video. However, the inherent depth ambiguity and self-occlusion i…