Grounding Generated Video Plans in Simulation Towards Versatile Dexterous Controllers

Tianyue Wu, Boyuan An, Shuqi Zhao +6

Generated hand-object interaction (HOI) videos provide a controllable way to propose manipulation motions. Simulation-based HOI tracking can translate such kinematic references int…