5 papers
Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories
Yueting Liu, Yanqin Jiang, Nian Liu +4
4D generation aims to animate 3D objects with realistic motion, holding great promise for applications. Existing methods typically decouple 3D asset generation from motion synthesi…
Video Echoed in Music: Semantic, Temporal, and Rhythmic Alignment for Video-to-Music Generation
Xinyi Tong, Yiran Zhu, Jishang Chen +9
Video-to-Music generation seeks to generate musically appropriate background music that enhances audiovisual immersion for videos. However, current approaches suffer from two criti…
Learning Uniformly Distributed Embedding Clusters of Stylistic Skills for Physically Simulated Characters
Nian Liu, Libin Liu, Zilong Zhang +6
Learning natural and diverse behaviors from human motion datasets remains challenging in physics-based character control. Existing conditional adversarial models often suffer from…
AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents
Jieming Cui, Tengyu Liu, Nian Liu +3
Traditional approaches in physics-based motion generation, centered around imitation learning and reward shaping, often struggle to adapt to new scenarios. To tackle this limitatio…
CivRealm: A Learning and Reasoning Odyssey in Civilization for Decision-Making Agents
Siyuan Qi, Shuo Chen, Yexin Li +11
The generalization of decision-making agents encompasses two fundamental elements: learning from past experiences and reasoning in novel contexts. However, the predominant emphasis…