12 papers
HumanDiffusion: A Vision-Based Diffusion Trajectory Planner with Human-Conditioned Goals for Search and Rescue UAV
Faryal Batool, Iana Zhura, Valerii Serpiva +4
Reliable human--robot collaboration in emergency scenarios requires autonomous systems that can detect humans, infer navigation goals, and operate safely in dynamic environments. T…
GuideTouch: An Obstacle Avoidance Device with Tactile Feedback for Visually Impaired
Timofei Kozlov, Artem Trandofilov, Georgii Gazaryan +3
Safe navigation for the visually impaired individuals remains a critical challenge, especially concerning head-level obstacles, which traditional mobility aids often fail to detect…
HoverAI: An Embodied Aerial Agent for Natural Human-Drone Interaction
Yuhua Jin, Nikita Kuzmin, Georgii Demianchuk +6
Drones operating in human-occupied spaces suffer from insufficient communication mechanisms that create uncertainty about their intentions. We present HoverAI, an embodied aerial a…
SafeHumanoid: VLM-RAG-driven Control of Upper Body Impedance for Humanoid Robot
Yara Mahmoud, Jeffrin Sam, Nguyen Khang +6
Safe and trustworthy Human Robot Interaction (HRI) requires robots not only to complete tasks but also to regulate impedance and speed according to scene context and human proximit…
VLH: Vision-Language-Haptics Foundation Model
Luis Francisco Moreno Fuentes, Muhammad Haris Khan, Miguel Altamirano Cabrera +5
We present VLH, a novel Visual-Language-Haptic Foundation Model that unifies perception, language, and tactile feedback in aerial robotics and virtual reality. Unlike prior work th…
FlyHaptics: Flying Multi-contact Haptic Interface
Luis Moreno, Miguel Altamirano Cabrera, Muhammad Haris Khan +4
This work presents FlyHaptics, an aerial haptic interface tracked via a Vicon optical motion capture system and built around six five-bar linkage assemblies enclosed in a lightweig…
HapticVLM: VLM-Driven Texture Recognition Aimed at Intelligent Haptic Interaction
Muhammad Haris Khan, Miguel Altamirano Cabrera, Dmitrii Iarchuk +4
This paper introduces HapticVLM, a novel multimodal system that integrates vision-language reasoning with deep convolutional networks to enable real-time haptic feedback. HapticVLM…
LLM-Glasses: GenAI-driven Glasses with Haptic Feedback for Navigation of Visually Impaired People
Issatay Tokmurziyev, Miguel Altamirano Cabrera, Muhammad Haris Khan +2
LLM-Glasses is a wearable navigation system which assists visually impaired people by utilizing YOLO-World object detection, GPT-4o-based reasoning, and haptic feedback for real-ti…
GazeGrasp: DNN-Driven Robotic Grasping with Wearable Eye-Gaze Interface
Issatay Tokmurziyev, Miguel Altamirano Cabrera, Luis Moreno +2
We present GazeGrasp, a gaze-based manipulation system enabling individuals with motor impairments to control collaborative robots using eye-gaze. The system employs an ESP32 CAM f…
Shake-VLA: Vision-Language-Action Model-Based System for Bimanual Robotic Manipulations and Liquid Mixing
Muhamamd Haris Khan, Selamawit Asfaw, Dmitrii Iarchuk +4
This paper introduces Shake-VLA, a Vision-Language-Action (VLA) model-based system designed to enable bimanual robotic manipulation for automated cocktail preparation. The system i…
Musinger: Communication of Music over a Distance with Wearable Haptic Display and Touch Sensitive Surface
Miguel Altamirano Cabrera, Muhammad Haris Khan, Ali Alabbas +3
This study explores the integration of auditory and tactile experiences in musical haptics, focusing on enhancing sensory dimensions of music through touch. Addressing the gap in t…
GazeRace: Revolutionizing Remote Piloting with Eye-Gaze Control
Issatay Tokmurziyev, Valerii Serpiva, Alexey Fedoseev +2
This paper presents GazeRace, a novel system that leverages eye-tracking technology for intuitive drone control. Using the MediaPipe library, the system translates eye movements in…