34 citations · 34 across the 11 of their papers we have counts for
11 papers
Linguistic Trajectory Encoding for Efficient Long-Horizon Spatial Memory in Embodied Agents
Tianyidan Xie, Shenyi Wang, Qiang Tang +7
Embodied agents performing long-horizon tasks require a memory representation in which the state transitions of dynamic objects remain queryable in natural language across hours-to…
SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion
Xinyu Chen, Yuyi Qian, Jiang Lin +9
Video object insertion requires ensuring spatio-temporal coherence and interactive realism, extending far beyond simple content placement. However, current approaches are often hin…
CineAGI: Character-Consistent Movie Creation through LLM-Orchestrated Multi-Modal Generation and Cross-Scene Integration
Tianyidan Xie, Zhentao Huang, Mingjie Wang +4
Automated movie creation requires coordinating multiple characters, modalities, and narrative elements across extended sequences -- a challenge that existing end-to-end approaches…
PhysLayer: Language-Guided Layered Animation with Depth-Aware Physics
Tianyidan Xie, Zhentao Huang, Mingjie Wang +4
Existing image-to-video generation methods often produce physically implausible motions and lack precise control over object dynamics. While prior approaches have incorporated phys…
Region-to-Region: Enhancing Generative Image Harmonization with Adaptive Regional Injection
Zhiqiu Zhang, Dongqi Fan, Mingjie Wang +3
The goal of image harmonization is to adjust the foreground in a composite image to achieve visual consistency with the background. Recently, latent diffusion model (LDM) are appli…
One-Shot Learning for Pose-Guided Person Image Synthesis in the Wild
Dongqi Fan, Tao Chen, Mingjie Wang +5
Current Pose-Guided Person Image Synthesis (PGPIS) methods depend heavily on large amounts of labeled triplet data to train the generator in a supervised manner. However, they ofte…
Prior-agnostic Multi-scale Contrastive Text-Audio Pre-training for Parallelized TTS Frontend Modeling
Quanxiu Wang, Hui Huang, Mingjie Wang +3
Over the past decade, a series of unflagging efforts have been dedicated to developing highly expressive and controllable text-to-speech (TTS) systems. In general, the holistic TTS…
GazeCLIP: Enhancing Gaze Estimation Through Text-Guided Multimodal Learning
Jun Wang, Hao Ruan, Liangjian Wen +2
Visual gaze estimation, with its wide-ranging application scenarios, has garnered increasing attention within the research community. Although existing approaches infer gaze solely…
CPNet: Exploiting CLIP-based Attention Condenser and Probability Map Guidance for High-fidelity Talking Face Generation
Jingning Xu, Benlai Tang, Mingjie Wang +2
Recently, talking face generation has drawn ever-increasing attention from the research community in computer vision due to its arduous challenges and widespread application scenar…
Towards Realistic Visual Dubbing with Heterogeneous Sources
Tianyi Xie, Liucheng Liao, Cheng Bi +7
The task of few-shot visual dubbing focuses on synchronizing the lip movements with arbitrary speech input for any talking head video. Albeit moderate improvements in current appro…
Towards Using Clothes Style Transfer for Scenario-aware Person Video Generation
Jingning Xu, Benlai Tang, Mingjie Wang +4
Clothes style transfer for person video generation is a challenging task, due to drastic variations of intra-person appearance and video scenarios. To tackle this problem, most rec…