Scalable In-Context Reinforcement Learning with Recurrent Algorithm Distillation

Yuanqing Ma, Zhenrui Zheng, Chenjun Xiao

Algorithm Distillation (AD) has demonstrated the remarkable ability of Transformers to perform in-context reinforcement learning without explicit weight updates. However, capturing…