250 citations · 479 across the 19 of their papers we have counts for
22 papers
Scaling Laws of Motion Forecasting and Planning -- Technical Report
Mustafa Baniodeh, Kratarth Goel, Scott Ettinger +14
We study the empirical scaling laws of a family of encoder-decoder autoregressive transformer models on the task of joint motion forecasting and planning in the autonomous driving…
Towards Unsupervised Object Detection From LiDAR Point Clouds
Lunjun Zhang, Anqi Joyce Yang, Yuwen Xiong +4
In this paper, we study the problem of unsupervised object detection from 3D point clouds in self-driving scenes. We present a simple yet effective method that exploits (i) point c…
Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving
Ben Agro, Quinlan Sykora, Sergio Casas +1
A self-driving vehicle (SDV) must be able to perceive its surroundings and predict the future behavior of other traffic participants. Existing works either perform object detection…
GoRela: Go Relative for Viewpoint-Invariant Motion Forecasting
Alexander Cui, Sergio Casas, Kelvin Wong +2
The task of motion forecasting is critical for self-driving vehicles (SDVs) to be able to plan a safe maneuver. Towards this goal, modern approaches reason about the map, the agent…
Just Label What You Need: Fine-Grained Active Selection for Perception and Prediction through Partially Labeled Scenes
Sean Segal, Nishanth Kumar, Sergio Casas +4
Self-driving vehicles must perceive and predict the future positions of nearby actors in order to avoid collisions and drive safely. A learned deep learning module is often respons…
IntentNet: Learning to Predict Intention from Raw Sensor Data
Sergio Casas, Wenjie Luo, Raquel Urtasun
In order to plan a safe maneuver, self-driving vehicles need to understand the intent of other traffic participants. We define intent as a combination of discrete high-level behavi…
MP3: A Unified Model to Map, Perceive, Predict and Plan
Sergio Casas, Abbas Sadat, Raquel Urtasun
High-definition maps (HD maps) are a key component of most modern self-driving systems due to their valuable semantic and geometric information. Unfortunately, building HD maps has…
End-to-end Interpretable Neural Motion Planner
Wenyuan Zeng, Wenjie Luo, Simon Suo +4
In this paper, we propose a neural motion planner (NMP) for learning to drive autonomously in complex urban scenarios that include traffic-light handling, yielding, and interaction…
TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors
Simon Suo, Sebastian Regalado, Sergio Casas +1
Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and th…
Diverse Complexity Measures for Dataset Curation in Self-driving
Abbas Sadat, Sean Segal, Sergio Casas +4
Modern self-driving autonomy systems heavily rely on deep learning. As a consequence, their performance is influenced significantly by the quality and richness of the training data…
Safety-Oriented Pedestrian Motion and Scene Occupancy Forecasting
Katie Luo, Sergio Casas, Renjie Liao +4
In this paper, we address the important problem in self-driving of forecasting multi-pedestrian motion and their shared scene occupancy map, critical for safe navigation. Our contr…
Deep Multi-Task Learning for Joint Localization, Perception, and Prediction
John Phillips, Julieta Martinez, Ioan Andrei Bârsan +3
Over the last few years, we have witnessed tremendous progress on many subtasks of autonomous driving, including perception, motion forecasting, and motion planning. However, these…
AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehicles
Jingkang Wang, Ava Pun, James Tu +5
As self-driving systems become better, simulating scenarios where the autonomy stack may fail becomes more important. Traditionally, those scenarios are generated for a few scenes…
LookOut: Diverse Multi-Future Prediction and Planning for Self-Driving
Alexander Cui, Sergio Casas, Abbas Sadat +2
In this paper, we present LookOut, a novel autonomy system that perceives the environment, predicts a diverse set of futures of how the scene might unroll and estimates the traject…
StrObe: Streaming Object Detection from LiDAR Packets
Davi Frossard, Simon Suo, Sergio Casas +3
Many modern robotics systems employ LiDAR as their main sensing modality due to its geometrical richness. Rolling shutter LiDARs are particularly common, in which an array of laser…
Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representations
Abbas Sadat, Sergio Casas, Mengye Ren +3
In this paper we propose a novel end-to-end learnable network that performs joint perception, prediction and motion planning for self-driving vehicles and produces interpretable in…
RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects
Bin Yang, Runsheng Guo, Ming Liang +2
We tackle the problem of exploiting Radar for perception in the context of self-driving as Radar provides complementary information to other sensors such as LiDAR or cameras in the…
Implicit Latent Variable Model for Scene-Consistent Motion Forecasting
Sergio Casas, Cole Gulino, Simon Suo +3
In order to plan a safe maneuver an autonomous vehicle must accurately perceive its environment, and understand the interactions among traffic participants. In this paper, we aim t…
PnPNet: End-to-End Perception and Prediction with Tracking in the Loop
Ming Liang, Bin Yang, Wenyuan Zeng +4
We tackle the problem of joint perception and motion forecasting in the context of self-driving vehicles. Towards this goal we propose PnPNet, an end-to-end model that takes as inp…
The Importance of Prior Knowledge in Precise Multimodal Prediction
Sergio Casas, Cole Gulino, Simon Suo +1
Roads have well defined geometries, topologies, and traffic rules. While this has been widely exploited in motion planning methods to produce maneuvers that obey the law, little wo…
Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Data
Sergio Casas, Cole Gulino, Renjie Liao +1
In this paper, we tackle the problem of relational behavior forecasting from sensor data. Towards this goal, we propose a novel spatially-aware graph neural network (SpAGNN) that m…
Discrete Residual Flow for Probabilistic Pedestrian Behavior Prediction
Ajay Jain, Sergio Casas, Renjie Liao +4
Self-driving vehicles plan around both static and dynamic objects, applying predictive models of behavior to estimate future locations of the objects in the environment. However, f…