7 papers
Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Driving
Adam Villaflor, Brian Yang, Huangyuan Su +3
Significant progress has been made in training multimodal trajectory forecasting models for autonomous driving. However, effectively integrating these models with downstream planne…
Track, Check, Repeat: An EM Approach to Unsupervised Tracking
Adam W. Harley, Yiming Zuo, Jing Wen +4
We propose an unsupervised method for detecting and tracking moving objects in 3D, in unlabelled RGB-D videos. The method begins with classic handcrafted techniques for segmenting…
Epipolar Transformers
Yihui He, Rui Yan, Katerina Fragkiadaki +1
A common approach to localize 3D human joints in a synchronized and calibrated multi-view setup consists of two-steps: (1) apply a 2D detector separately on each view to localize j…
Graph-Structured Visual Imitation
Maximilian Sieb, Zhou Xian, Audrey Huang +2
We cast visual imitation as a visual correspondence problem. Our robotic agent is rewarded when its actions result in better matching of relative spatial configurations for corresp…
Model Learning for Look-ahead Exploration in Continuous Control
Arpit Agarwal, Katharina Muelling, Katerina Fragkiadaki
We propose an exploration method that incorporates look-ahead search over basic learnt skills and their dynamics, and use it for reinforcement learning (RL) of manipulation policie…
Reinforcement Learning of Active Vision for Manipulating Objects under Occlusions
Ricson Cheng, Arpit Agarwal, Katerina Fragkiadaki
We consider artificial agents that learn to jointly control their gripperand camera in order to reinforcement learn manipulation policies in the presenceof occlusions from distract…