4 papers
Dual Exam: Controlled Evaluation of Multimodal Agents and World Models
Zhefan Rao, Meng Chu, Xuan Zhang +80
World Models (WMs) can support Multimodal Agents (MAs) through simulated experience, while Agent trajectories can inform World Model refinement. Evaluating this interaction require…
Improving through Interaction: Searching Behavioral Representation Spaces with CMA-ES-IG
Nathaniel Dennler, Zhonghao Shi, Yiran Tao +3
Robots that interact with humans must adapt to individual users' preferences to operate effectively in human-centered environments. An intuitive and effective technique to learn no…
LAMS: LLM-Driven Automatic Mode Switching for Assistive Teleoperation
Yiran Tao, Jehan Yang, Dan Ding +1
Teleoperating high degrees-of-freedom (DoF) robotic manipulators via low-DoF controllers like joysticks often requires frequent switching between control modes, where each mode map…
Incremental Learning for Robot Shared Autonomy
Yiran Tao, Guixiu Qiao, Dan Ding +1
Shared autonomy holds promise for improving the usability and accessibility of assistive robotic arms, but current methods often rely on costly expert demonstrations and remain sta…