5 papers
RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction
Tianyu Sun, Zhoujie Fu, Zihui Gao +2
Human-to-robot (H2R) object handover is a fundamental capability for human-robot collaboration, yet progress is hindered by the scarcity of large-scale, human-centric datasets and…
MVAnimate: Enhancing Character Animation with Multi-View Optimization
Tianyu Sun, Zhoujie Fu, Bang Zhang +1
The demand for realistic and versatile character animation has surged, driven by its wide-ranging applications in various domains. However, the animation generation algorithms mode…
PhyCustom: Towards Realistic Physical Customization in Text-to-Image Generation
Fan Wu, Cheng Chen, Zhoujie Fu +4
Recent diffusion-based text-to-image customization methods have achieved significant success in understanding concrete concepts to control generation processes, such as styles and…
iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generation
Zhoujie Fu, Xianfang Zeng, Jinghong Lan +9
Pre-trained video models learn powerful priors for generating high-quality, temporally coherent content. While these models excel at temporal coherence, their dynamics are often co…
In-Context Learning with Unpaired Clips for Instruction-based Video Editing
Xinyao Liao, Xianfang Zeng, Ziye Song +3
Despite the rapid progress of instruction-based image editing, its extension to video remains underexplored, primarily due to the prohibitive cost and complexity of constructing la…