Publications (15)
An End-to-End Human Simulator for Task-Oriented Multimodal Human-Robot Collaboration
Afagh Mehri Shervedani, Siyu Li, Natawut Monaikul +3
This paper proposes a neural network-based user simulator that can provide a multimodal interactive environment for training Reinforcement Learning (RL) agents in collaborative tas…
Understanding of Object Manipulation Actions Using Human Multi-Modal Sensory Data
Bahareh Abbasi, Ehsan Noohi, Sina Parastegari +1
Object manipulation actions represent an important share of the Activities of Daily Living (ADLs). In this work, we study how to enable service robots to use human multi-modal data…
Sensory Glove-Based Surgical Robot User Interface
Leonardo Borgioli, Ki-Hwan Oh, Valentina Valle +9
Robotic surgery has reached a high level of maturity and has become an integral part of standard surgical care. However, existing surgeon consoles are bulky, take up valuable space…
Interpreting Deepcode, a learned feedback code
Yingyao Zhou, Natasha Devroye, Gyorgy Turan +1
Deep learning methods have recently been used to construct non-linear codes for the additive white Gaussian noise (AWGN) channel with feedback. However, there is limited understand…
Comprehensive Robotic Cholecystectomy Dataset (CRCD): Integrating Kinematics, Pedal Signals, and Endoscopic Videos
Ki-Hwan Oh, Leonardo Borgioli, Alberto Mangano +9
In recent years, the potential applications of machine learning to Minimally Invasive Surgery (MIS) have spurred interest in data sets that can be used to develop data-driven tools…
Multimodal Reinforcement Learning for Robots Collaborating with Humans
Afagh Mehri Shervedani, Siyu Li, Natawut Monaikul +3
Robot assistants for older adults and people with disabilities need to interact with their users in collaborative tasks. The core component of these systems is an interaction manag…