4 papers
A Multimodal Data Collection Framework for Dialogue-Driven Assistive Robotics to Clarify Ambiguities: A Wizard-of-Oz Pilot Study
Guangping Liu, Nicholas Hawkins, Billy Madden +3
Integrated control of wheelchairs and wheelchair-mounted robotic arms (WMRAs) has strong potential to increase independence for users with severe motor limitations, yet existing in…
WheelArm-Sim: A Manipulation and Navigation Combined Multimodal Synthetic Data Generation Simulator for Unified Control in Assistive Robotics
Guangping Liu, Tipu Sultan, Vittorio Di Giorgio +3
Wheelchairs and robotic arms enhance independent living by assisting individuals with upper-body and mobility limitations in their activities of daily living (ADLs). Although recen…
Deployment of Large Language Models to Control Mobile Robots at the Edge
Pascal Sikorski, Leendert Schrader, Kaleb Yu +6
This paper investigates the possibility of intuitive human-robot interaction through the application of Natural Language Processing (NLP) and Large Language Models (LLMs) in mobile…
Improving Robotic Arms through Natural Language Processing, Computer Vision, and Edge Computing
Pascal Sikorski, Kaleb Yu, Lucy Billadeau +3
This paper introduces a prototype for a new approach to assistive robotics, integrating edge computing with Natural Language Processing (NLP) and computer vision to enhance the int…