4 papers · 1 filter
ReGen: Generative Robot Simulation via Inverse Design
Phat Nguyen, Tsun-Hsuan Wang, Zhang-Wei Hong +5
Simulation plays a key role in scaling robot learning and validating policies, but constructing simulations remains a labor-intensive process. This paper introduces ReGen, a genera…
Flex: End-to-End Text-Instructed Visual Navigation from Foundation Model Features
Makram Chahine, Alex Quach, Alaa Maalouf +2
End-to-end learning directly maps sensory inputs to actions, creating highly integrated and efficient policies for complex robotics tasks. However, such models often struggle to ge…
Text-to-Drive: Diverse Driving Behavior Synthesis via Large Language Models
Phat Nguyen, Tsun-Hsuan Wang, Zhang-Wei Hong +2
Generating varied scenarios through simulation is crucial for training and evaluating safety-critical systems, such as autonomous vehicles. Yet, the task of modeling the trajectori…
Probing Multimodal LLMs as World Models for Driving
Shiva Sreeram, Tsun-Hsuan Wang, Alaa Maalouf +3
We provide a sober look at the application of Multimodal Large Language Models (MLLMs) in autonomous driving, challenging common assumptions about their ability to interpret dynami…