A Survey on Human Interaction Motion Generation
arXiv:2503.12763 · doi:10.1007/s11263-025-02582-5
Abstract
Humans inhabit a world defined by interactions -- with other humans, objects, and environments. These interactive movements not only convey our relationships with our surroundings but also demonstrate how we perceive and communicate with the real world. Therefore, replicating these interaction behaviors in digital systems has emerged as an important topic for applications in robotics, virtual reality, and animation. While recent advances in deep generative models and new datasets have accelerated progress in this field, significant challenges remain in modeling the intricate human dynamics and their interactions with entities in the external world. In this survey, we present, for the first time, a comprehensive overview of the literature in human interaction motion generation. We begin by establishing foundational concepts essential for understanding the research background. We then systematically review existing solutions and datasets across three primary interaction tasks -- human-human, human-object, and human-scene interactions -- followed by evaluation metrics. Finally, we discuss open research directions and future opportunities.
The repository listing relevant papers is accessible at: https://github.com/soraproducer/Awesome-Human-Interaction-Motion-Generation
References in corpus (14)
- Diffusion Models in Vision: A Survey
- NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding
- Embodied Hands: Modeling and Capturing Hands and Bodies Together
- Benchmarking in Manipulation Research: The YCB Object and Model Set and Benchmarking Protocols
- Monocular Human Pose Estimation: A Survey of Deep Learning-based Methods
- Action2Motion: Conditioned Generation of 3D Human Motions
- The KIT Motion-Language Dataset
- GRAB: A Dataset of Whole-Body Human Grasping of Objects
- Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models
- InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions
- iMapper: Interaction-guided Joint Scene and Human Motion Mapping from Monocular Videos
- Synthesize Dexterous Nonprehensile Pregrasp for Ungraspable Objects
- DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions
- Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes