16 papers
Memory Retention Is Not Enough to Master Memory Tasks in Reinforcement Learning
Oleg Shchendrigin, Egor Cherepanov, Alexey K. Kovalev +1
Effective decision-making in the real world depends on memory that is both stable and adaptive: environments change over time, and agents must retain relevant information over long…
HELP: Hierarchical Embodied Language Planner for Household Tasks
Alexandr V. Korchemnyi, Anatoly O. Onishchenko, Eva A. Bakaeva +2
Embodied agents tasked with complex scenarios, whether in real or simulated environments, rely heavily on robust planning capabilities. When instructions are formulated in natural…
LookPlanGraph: Embodied Instruction Following Method with VLM Graph Augmentation
Anatoly O. Onishchenko, Alexey K. Kovalev, Aleksandr I. Panov
Methods that use Large Language Models (LLM) as planners for embodied instruction following tasks have become widespread. To successfully complete tasks, the LLM must be grounded i…
Don't Blind Your VLA: Aligning Visual Representations for OOD Generalization
Nikita Kachaev, Mikhail Kolosov, Daniil Zelezetsky +2
The growing success of Vision-Language-Action (VLA) models stems from the promise that pretrained Vision-Language Models (VLMs) can endow agents with transferable world knowledge a…
A New Perspective on Transformers in Online Reinforcement Learning for Continuous Control
Nikita Kachaev, Daniil Zelezetsky, Egor Cherepanov +2
Despite their effectiveness and popularity in offline or model-based reinforcement learning (RL), transformers remain underexplored in online model-free RL due to their sensitivity…
ELMUR: External Layer Memory with Update/Rewrite for Long-Horizon RL Problems
Egor Cherepanov, Alexey K. Kovalev, Aleksandr I. Panov
Real-world robotic agents must act under partial observability and long horizons, where key cues may appear long before they affect decision making. However, most modern approaches…