2 papers
cs.LG2026
Experience-based Knowledge Correction for Robust Planning in Minecraft
Seungjoon Lee, Suhwan Kim, Minhyeon Oh +2
Large Language Model (LLM)-based planning has advanced embodied agents in long-horizon environments such as Minecraft, where acquiring latent knowledge of goal (or item) dependenci…
cs.CL2025
Mitigating Attention Localization in Small Scale: Self-Attention Refinement via One-step Belief Propagation
Nakyung Lee, Yeongoon Kim, Minhae Oh +4
Transformer-based self-attention mechanism serves as the core of modern language models, yet it often suffers from localization, where attentions collapse onto a limited subset of…