13 papers
Evolve Vision-Language-Action Model into an Agent with On-the-fly Tool-use
Ding Yi, Yi Ding, Yanzhao Yu +6
This paper integrates end-to-end Visual-Language-Action (VLA) models with agentic tool-use to propose Agentic Robot with Tool-use (ART). ART is a tool-injection framework that tune…
Retrieve in Time, Correct in Frequency
Yuze Fan, Yue Cao, Pengjie Gao +7
Frozen vision-language-action (VLA) policies generate temporally extended action chunks, but long-horizon manipulation remains vulnerable to accumulated execution error and visual…
HERA: Historical Evidence Routing Adapter for Physical Prediction in Latent World Models
Yuanruyi, Yue Cao, Haojia Gao +7
Predictive video models have emerged as promising world models by learning latent visual dynamics from large-scale video. Yet these models remain challenged by physical events unde…
FlowPRO: Reward-Free Reinforced Fine-Tuning of Flow-Matching VLAs via Proximalized Preference Optimization
Yihao Wu, He Zhang, Junbo Tan +2
Post-training Vision-Language-Action (VLA) models into policies that can be reliably deployed on real robots remains a major bottleneck. SFT and DAgger exploit failure signals only…
RPG: Robust Policy Gating for Smooth Multi-Skill Transitions in Humanoid Fighting
Yucheng Xin, Jiacheng Bao, Yubo Dong +5
Humanoid robots have demonstrated impressive motor skills in a wide range of tasks, yet whole-body control for humanlike long-time, dynamic fighting remains particularly challengin…
Learn Weightlessness: Imitate Non-Self-Stabilizing Motions on Humanoid Robot
Yucheng Xin, Jiacheng Bao, Haoran Yang +6
The integration of imitation and reinforcement learning has enabled remarkable advances in humanoid whole-body control, facilitating diverse human-like behaviors. However, research…
PhotoAgent: A Robotic Photographer with Spatial and Aesthetic Understanding
Lirong Che, Zhenfeng Gan, Yanbo Chen +2
Embodied agents for creative tasks like photography must bridge the semantic gap between high-level language commands and geometric control. We introduce PhotoAgent, an agent that…
Choose What to Manipulate: Revealing Data Scaling Laws in Bounding-Box Guided Policies for Semantic Manipulation
Yihao Wu, Jinming Ma, Junbo Tan +5
Diffusion-based policies generalize poorly in semantic manipulation, a key obstacle to real-world deployment, because text-only instructions cannot reliably steer the policy toward…
Robust Policy Expansion for Offline-to-Online RL under Diverse Data Corruption
Longxiang He, Deheng Ye, Junbo Tan +2
Pretraining a policy on offline data followed by fine-tuning through online interactions, known as Offline-to-Online Reinforcement Learning (O2O RL), has emerged as a promising par…
A Hybrid Force-Position Strategy for Shape Control of Deformable Linear Objects With Graph Attention Networks
Yanzhao Yu, Haotian Yang, Junbo Tan +1
Manipulating deformable linear objects (DLOs) such as wires and cables is crucial in various applications like electronics assembly and medical surgeries. However, it faces challen…
Data-Driven MPC with Data Selection for Flexible Cable-Driven Robotic Arms
Huayue Liang, Yanbo Chen, Hongyang Cheng +5
Flexible cable-driven robotic arms (FCRAs) offer dexterous and compliant motion. Still, the inherent properties of cables, such as resilience, hysteresis, and friction, often lead…
A Universal Vehicle-Trailer Navigation System with Neural Kinematics and Online Residual Learning
Yanbo Chen, Yunzhe Tan, Yaojia Wang +3
Autonomous navigation of vehicle-trailer systems is crucial in environments like airports, supermarkets, and concert venues, where various types of trailers are needed to navigate…
Unlocking adaptive digital pathology through dynamic feature learning
Jiawen Li, Tian Guan, Qingxin Xia +17
Foundation models have revolutionized the paradigm of digital pathology, as they leverage general-purpose features to emulate real-world pathological practices, enabling the quanti…