4 papers
Motion Tracking with Muscles: Predictive Control of a Parametric Musculoskeletal Canine Model
Vittorio La Barbera, Steven Bohez, Leonard Hasenclever +2
We introduce a novel musculoskeletal model of a dog, procedurally generated from accurate 3D muscle meshes. Accompanying this model is a motion capture-based locomotion task compat…
Splatting Physical Scenes: End-to-End Real-to-Sim from Imperfect Robot Data
Ben Moran, Mauro Comi, Arunkumar Byravan +4
Creating accurate, physical simulations directly from real-world robot motion holds great value for safe, scalable, and affordable robot learning, yet remains exceptionally challen…
Gemini Robotics: Bringing AI into the Physical World
Gemini Robotics Team, Saminda Abeyruwan, Joshua Ainslie +115
Recent advancements in large multimodal models have led to the emergence of remarkable generalist capabilities in digital domains, yet their translation to physical agents such as…
Proc4Gem: Foundation models for physical agency through procedural generation
Yixin Lin, Jan Humplik, Sandy H. Huang +18
In robot learning, it is common to either ignore the environment semantics, focusing on tasks like whole-body control which only require reasoning about robot-environment contacts,…