13 papers
AgenticFocus: Object-Preserving Mixed Reality Synthesis from Human FPV Video for Dexterous Humanoid Learning
Iaroslav Kolomiets, Miguel Altamirano Cabrera, Artem Lykov +6
Human egocentric video is a scalable supervision source for humanoid policy learning, but current pipelines struggle with hand-object occlusion, oversimplified motion, or specializ…
Output-Level Regularization Eliminates the Seed Lottery in Single-GPU VLA Fine-Tuning
Jeffrin Sam, Dzmitry Tsetserukou
Fine-tuning a vision-language-action model (VLA-JEPA) on a single GPU should be simple: load a pretrained checkpoint, run training, deploy. There is a hidden danger. Run the same f…
Action Agent: Agentic Video Generation Meets Flow-Constrained Diffusion
Jeffrin Sam, Nguyen Khang, Yara Mahmoud +2
We present Action Agent, a two-stage framework that unifies agentic navigation video generation with flow-constrained diffusion control for multi-embodiment robot navigation. In St…
GenerativeMPC: VLM-RAG-guided Whole-Body MPC with Virtual Impedance for Bimanual Mobile Manipulation
Marcelino Julio Fernando, Miguel Altamirano Cabrera, Jeffrin Sam +3
Bimanual mobile manipulation requires a seamless integration between high-level semantic reasoning and safe, compliant physical interaction - a challenge that end-to-end models app…
DiffusionAnything: End-to-End In-context Diffusion Learning for Unified Navigation and Pre-Grasp Motion
Iana Zhura, Yara Mahmoud, Jeffrin Sam +4
Efficiently predicting motion plans directly from vision remains a fundamental challenge in robotics, where planning typically requires explicit goal specification and task-specifi…
DreamToNav: Generalizable Navigation for Robots via Generative Video Planning
Valerii Serpiva, Jeffrin Sam, Chidera Simon +4
We present DreamToNav, a novel autonomous robot framework that uses generative video models to enable intuitive, human-in-the-loop control. Instead of relying on rigid waypoint nav…
DiffusionCinema: Text-to-Aerial Cinematography
Valerii Serpiva, Artem Lykov, Jeffrin Sam +2
We propose a novel Unmanned Aerial Vehicles (UAV) assisted creative capture system that leverages diffusion models to interpret high-level natural language prompts and automaticall…
Glove2UAV: A Wearable IMU-Based Glove for Intuitive Control of UAV
Amir Habel, Ivan Snegirev, Elizaveta Semenyakina +6
This paper presents Glove2UAV, a wearable IMU-glove interface for intuitive UAV control through hand and finger gestures, augmented with vibrotactile warnings for exceeding predefi…
DroneVLA: VLA based Aerial Manipulation
Fawad Mehboob, Monijesu James, Amir Habel +3
As aerial platforms evolve from passive observers to active manipulators, the challenge shifts toward designing intuitive interfaces that allow non-expert users to command these sy…
SafeHumanoid: VLM-RAG-driven Control of Upper Body Impedance for Humanoid Robot
Yara Mahmoud, Jeffrin Sam, Nguyen Khang +6
Safe and trustworthy Human Robot Interaction (HRI) requires robots not only to complete tasks but also to regulate impedance and speed according to scene context and human proximit…
YawSitter: Modeling and Controlling a Tail-Sitter UAV with Enhanced Yaw Control
Amir Habel, Fawad Mehboob, Jeffrin Sam +2
Achieving precise lateral motion modeling and decoupled control in hover remains a significant challenge for tail-sitter Unmanned Aerial Vehicles (UAVs), primarily due to complex a…
PhysicalAgent: Towards General Cognitive Robotics with Foundation World Models
Artem Lykov, Jeffrin Sam, Hung Khang Nguyen +6
We introduce PhysicalAgent, an agentic framework for robotic manipulation that integrates iterative reasoning, diffusion-based video generation, and closed-loop execution. Given a…
UAV-CodeAgents: Scalable UAV Mission Planning via Multi-Agent ReAct and Vision-Language Reasoning
Oleg Sautenkov, Yasheerah Yaqoot, Muhammad Ahsan Mustafa +5
We present UAV-CodeAgents, a scalable multi-agent framework for autonomous UAV mission generation, built on large language and vision-language models (LLMs/VLMs). The system levera…