50 citations · 460 across the 28 of their papers we have counts for
29 papers
Multiface: A Dataset for Neural Face Rendering
Cheng-hsin Wuu, Ningyuan Zheng, Scott Ardisson +28
Photorealistic avatars of human faces have come a long way in recent years, yet research along this area is limited by a lack of publicly available, high-quality datasets covering…
MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error Propagation
Xinshuo Weng, Boris Ivanovic, Marco Pavone
Recently, there has been tremendous progress in developing each individual module of the standard perception-planning robot autonomy pipeline, including detection, tracking, predic…
Multi-Echo LiDAR for 3D Object Detection
Yunze Man, Xinshuo Weng, Prasanna Kumar Sivakuma +2
LiDAR sensors can be used to obtain a wide range of measurement signals other than a simple 3D point cloud, and those signals can be leveraged to improve perception tasks like 3D o…
Multi-Modality Task Cascade for 3D Object Detection
Jinhyung Park, Xinshuo Weng, Yunze Man +1
Point clouds and RGB images are naturally complementary modalities for 3D visual understanding - the former provides sparse but accurate locations of points on objects, while the l…
Wide-Baseline Multi-Camera Calibration using Person Re-Identification
Yan Xu, Yu-Jhe Li, Xinshuo Weng +1
We address the problem of estimating the 3D pose of a network of cameras for large-environment wide-baseline scenarios, e.g., cameras for construction sites, sports stadiums, and p…
AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecasting
Ye Yuan, Xinshuo Weng, Yanglan Ou +1
Predicting accurate future trajectories of multiple agents is essential for autonomous systems, but is challenging due to the complex agent interaction and the uncertainty in each…
Supervision by Registration and Triangulation for Landmark Detection
Xuanyi Dong, Yi Yang, Shih-En Wei +3
We present Supervision by Registration and Triangulation (SRT), an unsupervised approach that utilizes unlabeled multi-view video to improve the accuracy and precision of landmark…
AutoSelect: Automatic and Dynamic Detection Selection for 3D Multi-Object Tracking
Xinshuo Weng, Kris Kitani
3D multi-object tracking is an important component in robotic perception systems such as self-driving vehicles. Recent work follows a tracking-by-detection pipeline, which aims to…
End-to-End 3D Multi-Object Tracking and Trajectory Forecasting
Xinshuo Weng, Ye Yuan, Kris Kitani
3D multi-object tracking (MOT) and trajectory forecasting are two critical components in modern 3D perception systems. We hypothesize that it is beneficial to unify both tasks unde…
Graph Neural Networks for 3D Multi-Object Tracking
Xinshuo Weng, Yongxin Wang, Yunze Man +1
3D Multi-object tracking (MOT) is crucial to autonomous systems. Recent work often uses a tracking-by-detection pipeline, where the feature of each object is extracted independentl…
AB3DMOT: A Baseline for 3D Multi-Object Tracking and New Evaluation Metrics
Xinshuo Weng, Jianren Wang, David Held +1
3D multi-object tracking (MOT) is essential to applications such as autonomous driving. Recent work focuses on developing accurate systems giving less attention to computational co…
GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with Multi-Feature Learning
Xinshuo Weng, Yongxin Wang, Yunze Man +1
3D Multi-object tracking (MOT) is crucial to autonomous systems. Recent work uses a standard tracking-by-detection pipeline, where feature extraction is first performed independent…
Joint Object Detection and Multi-Object Tracking with Graph Neural Networks
Yongxin Wang, Kris Kitani, Xinshuo Weng
Object detection and data association are critical components in multi-object tracking (MOT) systems. Despite the fact that the two components are dependent on each other, prior wo…
When We First Met: Visual-Inertial Person Localization for Co-Robot Rendezvous
Xi Sun, Xinshuo Weng, Kris Kitani
We aim to enable robots to visually localize a target person through the aid of an additional sensing modality -- the target person's 3D inertial measurements. The need for such te…
Learning Shape Representations for Clothing Variations in Person Re-Identification
Yu-Jhe Li, Zhengyi Luo, Xinshuo Weng +1
Person re-identification (re-ID) aims to recognize instances of the same person contained in multiple images taken across different cameras. Existing methods for re-ID tend to rely…
Inverting the Pose Forecasting Pipeline with SPF2: Sequential Pointcloud Forecasting for Sequential Pose Forecasting
Xinshuo Weng, Jianren Wang, Sergey Levine +2
Many autonomous systems forecast aspects of the future in order to aid decision-making. For example, self-driving vehicles and robotic manipulation systems often forecast future ob…
PTP: Parallelized Tracking and Prediction with Graph Neural Networks and Diversity Sampling
Xinshuo Weng, Ye Yuan, Kris Kitani
Multi-object tracking (MOT) and trajectory prediction are two critical components in modern 3D perception systems that require accurate modeling of multi-agent interaction. We hypo…
3D Multi-Object Tracking: A Baseline and New Evaluation Metrics
Xinshuo Weng, Jianren Wang, David Held +1
3D multi-object tracking (MOT) is an essential component for many applications such as autonomous driving and assistive robotics. Recent work on 3D MOT focuses on developing accura…
Learning Spatio-Temporal Features with Two-Stream Deep 3D CNNs for Lipreading
Xinshuo Weng, Kris Kitani
We focus on the word-level visual lipreading, which requires recognizing the word being spoken, given only the video but not the audio. State-of-the-art methods explore the use of…
Monocular 3D Object Detection with Pseudo-LiDAR Point Cloud
Xinshuo Weng, Kris Kitani
Monocular 3D scene understanding tasks, such as object size estimation, heading angle estimation and 3D localization, is challenging. Successful modern day methods for 3D scene und…
On the Importance of Video Action Recognition for Visual Lipreading
Xinshuo Weng
We focus on the word-level visual lipreading, which requires to decode the word from the speaker's video. Recently, many state-of-the-art visual lipreading methods explore the end-…
Forecasting Time-to-Collision from Monocular Video: Feasibility, Dataset, and Challenges
Aashi Manglik, Xinshuo Weng, Eshed Ohn-Bar +1
We explore the possibility of using a single monocular camera to forecast the time to collision between a suitcase-shaped robot being pushed by its user and other nearby pedestrian…
Deep Reinforcement Learning for Autonomous Driving
Sen Wang, Daoyuan Jia, Xinshuo Weng
Reinforcement learning has steadily improved and outperform human in lots of traditional games since the resurgence of deep neural network. However, these success is not easy to be…
CyLKs: Unsupervised Cycle Lucas-Kanade Network for Landmark Tracking
Xinshuo Weng, Wentao Han
Across a majority of modern learning-based tracking systems, expensive annotations are needed to achieve state-of-the-art performance. In contrast, the Lucas-Kanade (LK) algorithm…