7 papers
DyneTrion: A Spatio-temporally Coherent Generative Emulator for Protein Dynamics Across Timescales
Kaihui Cheng, Zhiqiang Cai, Peng Tu +6
Proteins function through coordinated motion across multiple spatial and temporal scales, underpinning processes such as ligand binding, allostery, and catalysis. However, accessin…
MixFlow Training: Alleviating Exposure Bias with Slowed Interpolation Mixture
Hui Li, Fu-Yun Wang, Haoyuan Xia +4
This paper studies the training-testing discrepancy (a.k.a. exposure bias) problem for improving the diffusion models. During training, the input of a prediction network at one tra…
Prompt Reinjection: Alleviating Prompt Forgetting in Multimodal Diffusion Transformers for Text-to-Image Generation
Yuxuan Yao, Yuxuan Chen, Hui Li +6
Multimodal Diffusion Transformers (MMDiTs) for text-to-image generation maintain separate text and image branches, with bidirectional information flow between text tokens and visua…
Learning Implicit Bias in Generative Spaces for Accelerating Protein Dynamics Emulation
Kaihui Cheng, Zhiqiang Cai, Wenkai Xiang +4
Generative emulators of protein dynamics produce plausible trajectories at a fraction of the cost of molecular dynamics, but they inherit their training distribution and tend to re…
Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer
Jiahao Cui, Hui Li, Yun Zhan +7
Existing methodologies for animating portrait images face significant challenges, particularly in handling non-frontal perspectives, rendering dynamic objects around the portrait,…
OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generation
Hui Li, Mingwang Xu, Yun Zhan +8
Recent advancements in visual generation technologies have markedly increased the scale and availability of video datasets, which are crucial for training effective video generatio…