paper

MIRIAM: A Multimodal Chat-Based Interface for Autonomous Systems

arXiv:1803.02124 · doi:10.1145/3136755.3143022

Abstract

We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.

2 pages, ICMI'17, 19th ACM International Conference on Multimodal Interaction, November 13-17 2017, Glasgow, UK

MIRIAM: A Multimodal Chat-Based Interface for Autonomous Systems · wovepaper