2 papers
cs.LG2026
Vintix II: Decision Pre-Trained Transformer is a Scalable In-Context Reinforcement Learner
Andrei Polubarov, Lyubaykin Nikita, Alexander Derevyagin +11
Recent progress in in-context reinforcement learning (ICRL) has demonstrated its potential for training generalist agents that can acquire new tasks directly at inference. Algorith…
cs.LG2024
N-Gram Induction Heads for In-Context RL: Improving Stability and Reducing Data Needs
Ilya Zisman, Alexander Nikulin, Viacheslav Sinii +5
In-context learning allows models like transformers to adapt to new tasks from a few examples without updating their weights, a desirable trait for reinforcement learning (RL). How…