4 papers
SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenes
Léopold Maillard, Francis Engelmann, Tom Durand +5
Indoor 3D scenes are ultimately meant to be used: an embodied agent should be able to navigate, reach objects, and complete diverse activities. Yet whether a given scene actually s…
LookOut: Real-World Humanoid Egocentric Navigation
Boxiao Pan, Adam W. Harley, C. Karen Liu +1
The ability to predict collision-free future trajectories from egocentric observations is crucial in applications such as humanoid robotics, VR / AR, and assistive navigation. In t…
Animal Pose Labeling Using General-Purpose Point Trackers
Zhuoyang Pan, Boxiao Pan, Guandao Yang +2
Automatically estimating animal poses from videos is important for studying animal behaviors. Existing methods do not perform reliably since they are trained on datasets that are n…
ActAnywhere: Subject-Aware Video Background Generation
Boxiao Pan, Zhan Xu, Chun-Hao Paul Huang +4
Generating video background that tailors to foreground subject motion is an important problem for the movie industry and visual effects community. This task involves synthesizing b…