9 papers
Relational Geometry Forcing for World Action Models
Yuan Xu, Yixiang Chen, Qisen Ma +10
World Action Models (WAMs) have shown strong potential for robot manipulation by jointly learning visual dynamics and executable actions. However, their video and action objectives…
What Matters for World Modeling in Vision-Language-Action Models?
Qisen Ma, Yixiang Chen, Yuan Xu +10
Integrating world models into Vision-Language-Action models (VLAs) has emerged as a promising direction, enabling policies to anticipate future dynamics beyond reactive observation…
ViDAL: A Visual Dynamics-Grounded Action Latent Space for Vision-Language-Action Models
Yuan Xu, Yixiang Chen, Qisen Ma +10
Vision-Language-Action (VLA) models have become a central paradigm for robot policy learning, which predict actions in three forms: raw action chunks, discrete action tokens, or co…
FlowWAM: Optical Flow as a Unified Action Representation for World Action Models
Yixiang Chen, Peiyan Li, Yuan Xu +13
World Action Models (WAMs) are able to leverage pretrained video generators for both world modeling and action prediction. However, directly leveraging such video generators for co…
Multi-GRPO: Multi-Group Advantage Estimation for Text-to-Image Generation with Tree-Based Trajectories and Multiple Rewards
Qiang Lyu, Zicong Chen, Chongxiao Wang +9
Recently, Group Relative Policy Optimization (GRPO) has shown promising potential for aligning text-to-image (T2I) models, yet existing GRPO-based methods suffer from two critical…
RealDPO: Real or Not Real, that is the Preference
Guo Cheng, Danni Yang, Ziqi Huang +3
Video generative models have recently achieved notable advancements in synthesis quality. However, generating complex motions remains a critical challenge, as existing models often…
Style4D-Bench: A Benchmark Suite for 4D Stylization
Beiqi Chen, Shuai Shao, Haitang Feng +3
We introduce Style4D-Bench, the first benchmark suite specifically designed for 4D stylization, with the goal of standardizing evaluation and facilitating progress in this emerging…
Trajectory Attention for Fine-grained Video Motion Control
Zeqi Xiao, Wenqi Ouyang, Yifan Zhou +4
Recent advancements in video generation have been greatly driven by video diffusion models, with camera motion control emerging as a crucial challenge in creating view-customized v…
I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models
Wenqi Ouyang, Yi Dong, Lei Yang +2
The remarkable generative capabilities of diffusion models have motivated extensive research in both image and video editing. Compared to video editing which faces additional chall…