7 papers
Generalized Audio-Driven Synthesis of Precise Drummer Motion
Álvaro G. Iñesta, Mattia Ryffel, Amit H. Bermano +2
Music-driven character animation enables and enhances transformative applications in entertainment and interactive education. However, synthesizing realistic drumming motion from a…
Interactive Generative Motion Editing via Scheduled Inpainting
Dhruv Agrawal, Dominik Borer, Luca Vögeli +3
Motion editing is central to VFX and game development, where it is used extensively to modify and augment existing movements to conform to new environments or changes in artistic d…
Two2Four: Generative Quadruped Puppeteering from Human Motion
Fatemeh Zargarbashi, Zehong Qiu, Dhruv Agrawal +4
Realistic animal motion for virtual production is typically obtained either through motion capture of highly trained performers who accurately mimic animal behavior, or by retarget…
VQ-Style: Disentangling Style and Content in Motion with Residual Quantized Representations
Fatemeh Zargarbashi, Dhruv Agrawal, Jakob Buhmann +3
Human motion data is inherently rich and complex, containing both semantic content and subtle stylistic features that are challenging to model. We propose a novel method for effect…
Generalized Pose Space Embeddings for Training In-the-Wild using Anaylis-by-Synthesis
Dominik Borer, Jakob Buhmann, Martin Guay
Modern pose estimation models are trained on large, manually-labelled datasets which are costly and may not cover the full extent of human poses and appearances in the real world.…
Rig-space Neural Rendering
Dominik Borer, Lu Yuhang, Laura Wuelfroth +2
Movie productions use high resolution 3d characters with complex proprietary rigs to create the highest quality images possible for large displays. Unfortunately, these 3d assets a…
Animating an Autonomous 3D Talking Avatar
Dominik Borer, Dominik Lutz, Martin Guay
One of the main challenges with embodying a conversational agent is annotating how and when motions can be played and composed together in real-time, without any visual artifact. T…