5 citations · 25 across the 29 of their papers we have counts for
33 papers
AutodidactWAM: Cross-Modal Self-Distillation from Generated Video to Robot Actions
Sergei Kurchev, Iaroslav Kolomiets, Miguel Altamirano Cabrera +2
World-action models (WAMs) such as Cosmos 3 jointly generate future video and robot actions from an observation and instruction. Adapting one such model with a lightweight LoRA fin…
AgenticTactileVLA: Contact-Guided Execution-Time Supervision for Generalizable Dexterous Manipulation without VLA Retraining
Elizaveta Semenyakina, Ivan Snegirev, Mikhail Kiselev +4
Vision-language-action policies may predict a transferable manipulation strategy yet fail to realize it reliably on the encountered object: objects compatible with the same grasp d…
SocialVLA: A Social Perception Gateway for Human-Reaction-Based Failure Detection and Recovery in VLA Manipulation
Sofya Konstantinova, Miguel Altamirano Cabrera, Artem Lykov +1
Vision-language-action (VLA) policies enable diverse robotic manipulation but can fail during execution without recognizing their own errors. Human observers provide complementary…
ORCESTRA: VLM-driven Visual Robot programming in Mixed Reality
Ivan Snegirev, Elizaveta Semenyakina, Mikhail Konenkov +3
ORCESTRA is a mixed-reality system for programming robot digital twins through no-code waypoint teaching and language-guided control. In a passthrough mixed-reality workspace, user…
AgenticFocus: Object-Preserving Mixed Reality Synthesis from Human FPV Video for Dexterous Humanoid Learning
Iaroslav Kolomiets, Miguel Altamirano Cabrera, Artem Lykov +6
Human egocentric video is a scalable supervision source for humanoid policy learning, but current pipelines struggle with hand-object occlusion, oversimplified motion, or specializ…
DreamToNav: Generalizable Navigation for Robots via Generative Video Planning
Valerii Serpiva, Jeffrin Sam, Chidera Simon +4
We present DreamToNav, a novel autonomous robot framework that uses generative video models to enable intuitive, human-in-the-loop control. Instead of relying on rigid waypoint nav…
DiffusionCinema: Text-to-Aerial Cinematography
Valerii Serpiva, Artem Lykov, Jeffrin Sam +2
We propose a novel Unmanned Aerial Vehicles (UAV) assisted creative capture system that leverages diffusion models to interpret high-level natural language prompts and automaticall…
SafeHumanoid: VLM-RAG-driven Control of Upper Body Impedance for Humanoid Robot
Yara Mahmoud, Jeffrin Sam, Nguyen Khang +6
Safe and trustworthy Human Robot Interaction (HRI) requires robots not only to complete tasks but also to regulate impedance and speed according to scene context and human proximit…
FlightDiffusion: Revolutionising Autonomous Drone Training with Diffusion Models Generating FPV Video
Valerii Serpiva, Artem Lykov, Faryal Batool +3
We present FlightDiffusion, a diffusion-model-based framework for training autonomous drones from first-person view (FPV) video. Our model generates realistic video sequences from…
GestOS: Advanced Hand Gesture Interpretation via Large Language Models to control Any Type of Robot
Artem Lykov, Oleg Kobzarev, Dzmitry Tsetserukou
We present GestOS, a gesture-based operating system for high-level control of heterogeneous robot teams. Unlike prior systems that map gestures to fixed commands or single-agent ac…
PhysicalAgent: Towards General Cognitive Robotics with Foundation World Models
Artem Lykov, Jeffrin Sam, Hung Khang Nguyen +6
We introduce PhysicalAgent, an agentic framework for robotic manipulation that integrates iterative reasoning, diffusion-based video generation, and closed-loop execution. Given a…
UAV-CodeAgents: Scalable UAV Mission Planning via Multi-Agent ReAct and Vision-Language Reasoning
Oleg Sautenkov, Yasheerah Yaqoot, Muhammad Ahsan Mustafa +5
We present UAV-CodeAgents, a scalable multi-agent framework for autonomous UAV mission generation, built on large language and vision-language models (LLMs/VLMs). The system levera…
RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviour
Valerii Serpiva, Artem Lykov, Artyom Myshlyaev +4
RaceVLA presents an innovative approach for autonomous racing drone navigation by leveraging Visual-Language-Action (VLA) to emulate human-like behavior. This research explores the…
CognitiveDrone: A VLA Model and Evaluation Benchmark for Real-Time Cognitive Task Solving and Reasoning in UAVs
Artem Lykov, Valerii Serpiva, Muhammad Haris Khan +5
This paper introduces CognitiveDrone, a novel Vision-Language-Action (VLA) model tailored for complex Unmanned Aerial Vehicles (UAVs) tasks that demand advanced cognitive abilities…
UAV-VLRR: Vision-Language Informed NMPC for Rapid Response in UAV Search and Rescue
Yasheerah Yaqoot, Muhammad Ahsan Mustafa, Oleg Sautenkov +3
Emergency search and rescue (SAR) operations often require rapid and precise target identification in complex environments where traditional manual drone control is inefficient. In…
UAV-VLPA*: A Vision-Language-Path-Action System for Optimal Route Generation on a Large Scales
Oleg Sautenkov, Aibek Akhmetkazy, Yasheerah Yaqoot +4
The UAV-VLPA* (Visual-Language-Planning-and-Action) system represents a cutting-edge advancement in aerial robotics, designed to enhance communication and operational efficiency fo…
Evolution 6.0: Robot Evolution through Generative Design
Muhammad Haris Khan, Artyom Myshlyaev, Artem Lykov +2
We propose a new concept, Evolution 6.0, which represents the evolution of robotics driven by Generative AI. When a robot lacks the necessary tools to accomplish a task requested b…
GestLLM: Advanced Hand Gesture Interpretation via Large Language Models for Human-Robot Interaction
Oleg Kobzarev, Artem Lykov, Dzmitry Tsetserukou
This paper introduces GestLLM, an advanced system for human-robot interaction that enables intuitive robot control through hand gestures. Unlike conventional systems, which rely on…
UAV-VLA: Vision-Language-Action System for Large Scale Aerial Mission Generation
Oleg Sautenkov, Yasheerah Yaqoot, Artem Lykov +7
The UAV-VLA (Visual-Language-Action) system is a tool designed to facilitate communication with aerial robots. By integrating satellite imagery processing with the Visual Language…
Industry 6.0: New Generation of Industry driven by Generative AI and Swarm of Heterogeneous Robots
Artem Lykov, Miguel Altamirano Cabrera, Mikhail Konenkov +8
This paper presents the concept of Industry 6.0, introducing the world's first fully automated production system that autonomously handles the entire product design and manufacturi…
METDrive: Multi-modal End-to-end Autonomous Driving with Temporal Guidance
Ziang Guo, Xinhao Lin, Zakhar Yagudin +4
Multi-modal end-to-end autonomous driving has shown promising advancements in recent work. By embedding more modalities into end-to-end networks, the system's understanding of both…
FADet: A Multi-sensor 3D Object Detection Network based on Local Featured Attention
Ziang Guo, Zakhar Yagudin, Selamawit Asfaw +2
Camera, LiDAR and radar are common perception sensors for autonomous driving tasks. Robust prediction of 3D object detection is optimally based on the fusion of these sensors. To e…
FlockGPT: Guiding UAV Flocking with Linguistic Orchestration
Artem Lykov, Sausar Karaf, Mikhail Martynov +4
This article presents the world's first rapid drone flocking control using natural language through generative AI. The described approach enables the intuitive orchestration of a f…
Robots Can Feel: LLM-based Framework for Robot Ethical Reasoning
Artem Lykov, Miguel Altamirano Cabrera, Koffivi Fidèle Gbagbe +1
This paper presents the development of a novel ethical reasoning framework for robots. "Robots Can Feel" is the first system for robots that utilizes a combination of logic and hum…