4 papers
CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight
Chensheng Peng, Wenhao Ding, Ran Tian +9
World action models (WAMs) jointly predict actions (intent) and visual future (foresight). Standard training adds noise to recorded actions and video simultaneously, but such train…
Vision-Language-Action Autonomous Driving Agent with Language-based Memory
Kai Yan, Xiangyu Chen, Yulong Cao +9
Vision-Language-Action (VLA) foundation models have recently emerged as one of the prevailing solutions for autonomous driving, as they can utilize knowledge acquired during vision…
Monkey See, Can Monkey Do? A Benchmark for Evaluating Robot Skill Learning by Observation
Weiwei Gu, Anmol Gupta, Anant Sah +5
Learning from Observation (LfO) is a fundamental robotic capability that replicates how humans and animals socially learn from each other. Beyond its biological parallels, this mod…
Receding Horizon Planning with Rule Hierarchies for Autonomous Vehicles
Sushant Veer, Karen Leung, Ryan Cosner +3
Autonomous vehicles must often contend with conflicting planning requirements, e.g., safety and comfort could be at odds with each other if avoiding a collision calls for slamming…