A Survey on Reinforcement Learning Methods in Character Animation

Abstract

Reinforcement Learning is an area of Machine Learning focused on how agents can be trained to make sequential decisions, and achieve a particular goal within an arbitrary environment. While learning, they repeatedly take actions based on their observation of the environment, and receive appropriate rewards which define the objective. This experience is then used to progressively improve the policy controlling the agent's behavior, typically represented by a neural network. This trained module can then be reused for similar problems, which makes this approach promising for the animation of autonomous, yet reactive characters in simulators, video games or virtual reality environments. This paper surveys the modern Deep Reinforcement Learning methods and discusses their possible applications in Character Animation, from skeletal control of a single, physically-based character to navigation controllers for individual agents and virtual crowds. It also describes the practical side of training DRL systems, comparing the different frameworks available to build such agents.

arXiv comment27 pages, 6 figures, Eurographics STAR, Computer Graphics Forum

References in corpus (8)

• Array Programming with NumPy
• Character Controllers Using Motion VAEs
• Learning Symmetric and Low-energy Locomotion
• Learning Locomotion Skills Using DeepRL: Does the Choice of Action Space Matter?
• Synthesis of Biologically Realistic Human Motion Using Joint Torque Actuation
• Surface Multigrid via Intrinsic Prolongation
• Learning to Locomote: Understanding How Environment Design Matters for Deep Reinforcement Learning
• The Archimedean trap: Why traditional reinforcement learning will probably not yield AGI

Cited by in corpus (1)

• Reward Function Design for Crowd Simulation via Reinforcement Learning