7 papers · 1 filter
SafeHumanoid: VLM-RAG-driven Control of Upper Body Impedance for Humanoid Robot
Yara Mahmoud, Jeffrin Sam, Nguyen Khang +6
Safe and trustworthy Human Robot Interaction (HRI) requires robots not only to complete tasks but also to regulate impedance and speed according to scene context and human proximit…
VLH: Vision-Language-Haptics Foundation Model
Luis Francisco Moreno Fuentes, Muhammad Haris Khan, Miguel Altamirano Cabrera +5
We present VLH, a novel Visual-Language-Haptic Foundation Model that unifies perception, language, and tactile feedback in aerial robotics and virtual reality. Unlike prior work th…
FlyHaptics: Flying Multi-contact Haptic Interface
Luis Moreno, Miguel Altamirano Cabrera, Muhammad Haris Khan +4
This work presents FlyHaptics, an aerial haptic interface tracked via a Vicon optical motion capture system and built around six five-bar linkage assemblies enclosed in a lightweig…
HapticVLM: VLM-Driven Texture Recognition Aimed at Intelligent Haptic Interaction
Muhammad Haris Khan, Miguel Altamirano Cabrera, Dmitrii Iarchuk +4
This paper introduces HapticVLM, a novel multimodal system that integrates vision-language reasoning with deep convolutional networks to enable real-time haptic feedback. HapticVLM…
LLM-Glasses: GenAI-driven Glasses with Haptic Feedback for Navigation of Visually Impaired People
Issatay Tokmurziyev, Miguel Altamirano Cabrera, Muhammad Haris Khan +2
LLM-Glasses is a wearable navigation system which assists visually impaired people by utilizing YOLO-World object detection, GPT-4o-based reasoning, and haptic feedback for real-ti…
GazeGrasp: DNN-Driven Robotic Grasping with Wearable Eye-Gaze Interface
Issatay Tokmurziyev, Miguel Altamirano Cabrera, Luis Moreno +2
We present GazeGrasp, a gaze-based manipulation system enabling individuals with motor impairments to control collaborative robots using eye-gaze. The system employs an ESP32 CAM f…
Shake-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Manipulations and Liquid Mixing
Muhamamd Haris Khan, Selamawit Asfaw, Dmitrii Iarchuk +4
This paper introduces Shake-VLA, a Vision-Language-Action (VLA) model-based system designed to enable bimanual robotic manipulation for automated cocktail preparation. The system i…