9 papers
Hear the World in Stereo: Learning Dynamic Spatial Correspondence for Immersive Joint Video-Audio Generation
Hanmo Chen, Chengcheng Liu, Tianxiao Chen +8
Recent joint video-audio generation models have achieved strong semantic correspondence and temporal synchronization. However, applications such as AR/VR and interactive gaming fur…
EditaLive! Unified Character Video Editing for Live Streaming
Zhiyuan Li, Chi-Man Pun, Peng-Tao Jiang +2
Conventional video editing primarily focuses on scene-level content, whereas live streaming places greater emphasis on the human subject. However, directly applying existing video-…
MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer
Ziyi Wang, Siming Zheng, Yang Yang +5
Makeup-transfer applies the reference makeup to the source face while preserving the source identity. Despite advances in full-face editing by diffusion-based methods, strong regio…
ReDiffuse: Rotation Equivariant Diffusion Model for Multi-focus Image Fusion
Bo Li, Tingting Bao, Lingling Zhang +3
Diffusion models have achieved impressive performance on multi-focus image fusion (MFIF). However, a key challenge in applying diffusion models to the ill-posed MFIF problem is tha…
FlowConsist: Make Your Flow Consistent with Real Trajectory
Tianyi Zhang, Chengcheng Liu, Jinwei Chen +5
Fast flow models accelerate the iterative sampling process by learning to directly predict ODE path integrals, enabling one-step or few-step generation. However, we argue that curr…
Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modeling
Yuan Wang, Yuhao Wan, Siming Zheng +3
Recent works have explored reference-based super-resolution (RefSR) to mitigate hallucinations in diffusion-based image restoration. A key challenge is that real-world degradations…
CameraMaster: Unified Camera Semantic-Parameter Control for Photography Retouching
Qirui Yang, Yang Yang, Ying Zeng +5
Text-guided diffusion models have greatly advanced image editing and generation. However, achieving physically consistent image retouching with precise parameter control (e.g., exp…
MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
Guangyuan Li, Bo Li, Jinwei Chen +3
Recent interactive video world model methods generate scene evolution conditioned on user instructions. Although they achieve impressive results, two key limitations remain. First,…
RED: Robust Event-Guided Motion Deblurring with Modality-Specific Disentanglement
Yihong Leng, Siming Zheng, Jinwei Chen +3
Event-guided motion deblurring reconstructs sharp images using the high-temporal-resolution motion cues from event cameras. However, in real capture, thresholding-induced event und…