17 papers
CLEAR: Closed-Loop Reinforcement Learning at Scale for End-to-End Autonomous Driving
Yunxiao Shi, Hong Cai, Mohammad Ghavamzadeh +1
End-to-end autonomous driving (E2E-AD) aims to directly map raw sensor information to driving actions. Recently, with the rapid advancement of multi-modal large language models (ML…
SciFlow: Semantic Cross Interference for Self-Supervised Optical Flow Domain Generalization
Jamie Menjay Lin, Jisoo Jeong, Hong Cai +2
Motions of objects and scenes carry essential intelligence in video understanding, offering rich cues for interpreting dynamic settings and interactions. Due to the cost and scarci…
RoCA: Robust Cross-Domain End-to-End Autonomous Driving
Rajeev Yasarla, Shizhong Han, Hsin-Pai Cheng +7
End-to-end (E2E) autonomous driving has recently emerged as a new paradigm, offering significant potential. However, few studies have looked into the practical challenge of deploym…
FALO: Fast and Accurate LiDAR 3D Object Detection on Resource-Constrained Devices
Shizhong Han, Hsin-Pai Cheng, Hong Cai +3
Existing LiDAR 3D object detection methods predominantely rely on sparse convolutions and/or transformers, which can be challenging to run on resource-constrained edge devices, due…
BePo: Dual Representation for 3D Occupancy Prediction
Yunxiao Shi, Hong Cai, Jisoo Jeong +4
3D occupancy infers fine-grained 3D geometry and semantics which is critical for autonomous driving. Most existing approaches carry high compute costs, requiring dense 3D feature v…
Neodragon: Mobile Video Generation using Diffusion Transformer
Animesh Karnewar, Denis Korzhenkov, Ioannis Lelekas +10
We introduce Neodragon, a text-to-video system capable of generating 2s (49 frames @24 fps) videos at the 640x1024 resolution directly on a Qualcomm Hexagon NPU in a record 6.7s (7…