9 papers
Fluid-DiT: Graph-Free Diffusion Transformers for Fluid Flow Simulations Learning
Shentong Mo, Guolin Ke
Simulating complex fluid flows requires capturing full equilibrium distributions rather than just mean trajectories, yet high-fidelity solvers remain computationally prohibitive. R…
Improving Visual Representation Alignment Generation with GRPO
Shentong Mo, Sukmin Yun
Recent diffusion transformers have demonstrated strong image synthesis capabilities but remain inefficient to train due to weak alignment between generative and discriminative repr…
Chain of Uncertain Rewards with Large Language Models for Reinforcement Learning
Shentong Mo
Designing effective reward functions is a cornerstone of reinforcement learning (RL), yet it remains a challenging and labor-intensive process due to the inefficiencies and inconsi…
LVRPO: Language-Visual Alignment with GRPO for Multimodal Understanding and Generation
Shentong Mo, Sukmin Yun
Unified multimodal pretraining has emerged as a promising paradigm for jointly modeling language and vision within a single foundation model. However, existing approaches largely r…
Foley-Flow: Coordinated Video-to-Audio Generation with Masked Audio-Visual Alignment and Dynamic Conditional Flows
Shentong Mo, Yibing Song
Coordinated audio generation based on video inputs typically requires a strict audio-visual (AV) alignment, where both semantics and rhythmics of the generated audio segments shall…
Scaling Up Audio-Synchronized Visual Animation: An Efficient Training Paradigm
Lin Zhang, Zefan Cai, Yufan Zhou +10
Recent advances in audio-synchronized visual animation enable control of video content using audios from specific classes. However, existing methods rely heavily on expensive manua…