Heuristic Transformer: Belief Augmented In-Context Reinforcement Learning

Oliver Dippel, Alexei Lisitsa, Bei Peng

Transformers have demonstrated exceptional in-context learning (ICL) capabilities, enabling applications across natural language processing, computer vision, and sequential decisio…