Context-aware robot control using gesture episodes
arXiv:2301.09899 · doi:10.1109/ICRA48891.2023.10161308
Abstract
Collaborative robots became a popular tool for increasing productivity in partly automated manufacturing plants. Intuitive robot teaching methods are required to quickly and flexibly adapt the robot programs to new tasks. Gestures have an essential role in human communication. However, in human-robot-interaction scenarios, gesture-based user interfaces are so far used rarely, and if they employ a one-to-one mapping of gestures to robot control variables. In this paper, we propose a method that infers the user's intent based on gesture episodes, the context of the situation, and common sense. The approach is evaluated in a simulated table-top manipulation setting. We conduct deterministic experiments with simulated users and show that the system can even handle personal preferences of each user.
arXiv comment7 pages, 8 figures, accepted for ICRA 2023
References in corpus (5)
- Exploiting Recurrent Neural Networks and Leap Motion Controller for Sign Language and Semaphoric Gesture Recognition
- PyRep: Bringing V-REP to Deep Robot Learning
- Gesture-based Human-Machine Interaction: Taxonomy, Problem Definition, and Analysis
- Online Human Gesture Recognition using Recurrent Neural Networks and Wearable Sensors
- Pymc-learn: Practical Probabilistic Machine Learning in Python